It sounds to me as if there is a control issue going on here. He lifts your spirits by sorting a holiday out with you then crashes you down by changing his mind. The same goes for dining out. You get invitations but he says it's too expensive. Eventually people will stop inviting you out.
Break the pattern now before it's too late. Have you enough of your own money to go on a mid-week or weekend break? I'm thinking of something like a spa or a hotel where you can chill, eat chocolate, drink whatever you like to imbibe, read, listen to music, chat to strangers, people watch and generally chill out. Warners is good for that if you can afford it. Some have spas attached so you can treat yourself even more if you want to. Massage, hot stones, manicure, pedicure etc.
The same goes for evenings out with friends. If he won't go then go without him.
Don't let him crush you and make you lose all your friends.
I've been there and it's no fun.
I'm sorry if I'm misjudging your husband. Only you will know that.