I have been a traveller , both living abroad and holidaying abroad too. Never been into sitting around on a beach, and have done lots of camping, city breaks and sailed my own old yacht round especially the hebrides and west coast of scotland. I have never been sorry that I have travelled, and have always thought it was worth all the effort, you come home with some lovely memories. If a time comes where for reasons of health or whatever that you can no longer travel then you have to accept that but you do have lots of good memories to enjoy. Have met so many people over the years and there was only one person who tripped and broke their leg, but the worst apart from that over more than 30 years has been people having upset stomachs. I do think that if you take the normal sensible precautions you are no more likely to have problems wherever you go.
You might look at it in another way. When you go out for the day , or go shopping, do you just think of common sense things , such as look at the weather and take your mac with you, or do you carry a mac, sunglasses, heavy sweater and wellington boots, just in case? If you really feel that you have no wish to travel abroad again,then of course that is your choice, but your husband perhaps might be able to travel with a friend so he could still enjoy the trips for as long as he wanted to?
Alternatively have you thought of someone like Fred Olsen cruises, as a halfway meeting? They are smaller ships, very well run, have good lecturers on the places you are visiting, and you could choose to stay aboard on any of the days of the trips, if they did not appeal to you. I have found them very good , with the food and the library etc It might be something that would perhaps suit you both, and they have quite a wide choice of destinations. I have been up to the Artic with them and down to Maderia etc , and have always found them very good , and also you dont have to traipse down to southampton if you live in the north, which is another plus from my point of view. Hope you find something to still enjoy while you can. Best of luck.