Why are you trying to "appease an angry man" instead of giving him a rocket?
It sounds to me as if he is completely ignoring your health issues, your wishes, and likes and dislikes.
Forgive me if I am being unhelpful, but in your place, I would tell him that if he wants an extra holiday, he can have it, as long as you both can afford it, but he goes off on it on his own, because you no longer are able to enjoy travelling.
And that you would really like him to show you a little consideration, now and again, instead of always having to fall in with his wishes.
He may not have realised how tiring you find being away from home, you know.