I don't think it is a good idea for any group to meet in a private home, and that nasty U3A must be the exception to all the good ones. Our U3A in Ipswich Queensland Australia is lovely and inclusive, with loads of courses - French, German, Indonesian, Biology, history, writers' group, English literature, performance group, mah jong, various card games, scrabble, line dancing, contract law, and many others things. I'm in writers' and the performance group. We meet at either the Library or the Humanities Centre and our local council lets us have rooms for free, so we get by on membership of A$30 a year (UKP20-ish)
The secret of happiness is to associate with people you get on with and share some common ground: for this reason I'm happy with U3A. We are open to anyone over 18, though of course most members are retired as classes are during the daytime. I find my mind gets stretched, and I learn a lot from the others.
Good luck finding something, Sel. We've had a few false starts in the past: a caravan club proved to be racist, so we never joined, and our local Labour party branch started to get a bit cliquey, so we simply stopped going. Instead I go to an occasional lunch get-together for retired party members who'd rather meet during the day.
There's always a solution - somewhere.