Apart from my father and my sister, now both dead, who liked my husband, the rest of my family made and make it clear that they don't care all that much for him.
So I know how you feel. I wasted a lot of time and energy trying to smooth things over, and feeling hurt by my family' s behaviour.
Now, I have accepted, and fortunately my DH is all right with it too, that though I am very welcome in his family, my nieces and nephew prefer me to visit on my own. So that is basically what I do and I don't invite them here, because honestly, if they can't be polite to my husband for my sake, I feel that says quite a lot about how fond they actually are of me.
I realize they don't see it that way. How does your man feel about the situation? I would suggest you do much the same as I have done, if he is all right with it. And if your DD and SIL make remarks about you coming alone to family parties, I, if I were you, would say quite calmly that your partner does not feel particularly welcome, which is why he doesn't come with you.