Unless you are being mischievous, Frank, you must see that it is women who you think must adjust their lives to suit men and wear clothes that are not provocative, but they must not object when men stand and watch them climb out of the pool in nothing but a dripping swimsuit at the end of a session when they thought they could rely on being unobserved by lascivious eyes. How come these men are allowed on the poolside before the pool is empty, if it is a ladies only session?
Women had to band together to get access to all the things that men took for granted for centuries - education, the vote, entrance to the professions, equality in the Church, equal pay, access to their children in matrimonial disputes. If you and a few friends want all-male swimming sessions and exercise classes, then go for it - fight for your rights. It will not be easy, but for inspiration you can look to the women who had to fight - the Pankhursts, Elizabeth Garrett Anderson, Mary Seacole, Nancy Astor, Amelia Erhardt, Elizabeth Fry, to name but a few.