This sounds like classic gaslighting (which I realise is a bit of a cliché now).
Being just nice enough so that you stay but nasty enough so that your life is unpleasant. It is manipulative, controlling behaviour.
There is a site called Gaslighting for Dummies which is quite good at defining it and it may be easier to deal with once you realise the methods they use.
Ultimately the advice they give is that no one person is worth losing your sanity for. You have to decide how bearable this is and how much you are going to be able to rein it in.
Don't let him stop you from building up a separate life outside the home by his reaction to it. It is hard enough to do that when you get older without letting someone undermine your efforts.
Adult kids staying and not contributing.
Where can I donate a wheelchair apart from the tip?
Soops kitchen, a place of reflection, refuge and at times revelry.


.
.
but if he is a good DH it’s worth putting up with IMHO.