I agree with Rosalyn on this. OP's husband is not unreasonable to dislike mess and upheaval in his home. I know I would hate it!
Maybe you could care for the child in his own home? Or perhaps only have him once a week and cut out the weekend stays?
I understand that you have a close bond with your grandson but, if it came to a choice between making my partner unhappy or seeing less of my grandchild, I'd opt for keeping the peace at home. (And no, that's not me being a doormat and giving in to a controlling spouse; I just know where my priorities lie).
The Devil In The Family: The Fall of Ruby Franke - BBC IPlayer
Labelling cake tins or cutlery you have loaned.
Daughter not allowed to know new baby’s name until she visits him
