I have considered it, but not done it (yet). If you have loads of good friends where you currently live, I'd think carefully before leaving.
But it sounds appealing. I'd look up the u3a in the town you are considering, to see how much is going on locally for our age group. Although you say peaceful, I'd go for a small town, it would be good to join some groups and make friends. Check any theatres, cinemas.
I'd also check out nearest hospitals not too far away!
I would love to live by the coast where I could walk along the front everyday, I love the sea.
Id also see where you can get to from there on public transport, especially buses, as you might not be able to drive at some point. It would be good to get to some bigger livelier places sometimes.