Your plan seems ideal, and most people seem to agree that it's a good idea. Remember, though, when choosing a new home, that you may not always be able to drive. My friends bought a lovely house, then after some years the husband died. She couldn't drive, and was also suffering with some mobility problems by then. She had great difficulty in walking the half mile to the nearest bus stop, and getting about became a real problem.
I also foresee similar problems for myself at some point. I'm a widow, and very mobile until recently. Now osteo arthritis is setting in, and I know that if I have to stop driving life is going to be difficult. I will probably have to think about a house move myself, before too long.
Whatever your decision, may I wish you 'all the best'.