Sorry but first of all what is or who is AC.,
Now then, I know I'm a granny, I list both parents in my early years 4yrs. & 18yrs. Hence wasn't to sure how to play it.
When I married my MIL, appear at anytime, with, "it's only me" as she had a key.
Now I'm a granny, I'm in 7th heaven, but I don't go round unless invited, although DD & SIL, drop in as and when as has been said this is her family home & the door is always open.
I guess we have to take it as it is, some weeks we see DGS, every day, some weeks once or twice a week, sometimes weekends they just pop in.
Their family, so we take it as it happens.
I hope you manage to sort your situation out & your DH, comes to terms with the arrangement, you could always mention that it's hurting him. Maybe they think you only want to see them once a week.
Triciax