I so agree with the idea that moving in between friends and family is a bad move - you finish up with the worst of both worlds.
At one time we were going to move away, but how glad I am that we did not! - I had a fall when I was 65, and the breakages limit my mobility still - I also had a hip replacement that did not have a good result. My OH was diagnosed with PD. The idea of us having to move to a bungalow (which we have just done) because of mobility problems would never have entered our heads, just as they have not entered yours! We were fit and active and nothing could have been further from our thoughts.
Honestly - either live near your friends or near your family. If you are a distance from your family your visits will still be an "event" - we are near two of our daughters and we are closely and happily involved with the GC. For example, One DD had to take her son to the doctor today, so she dropped by and left her daughter with us for half an hour.
The option you are choosing and the lifestyle you are hoping for are wholly dependent on continuing good health. As we get older that is in no way to be relied upon.
Sorry to sound gloomy, but that is the reality.