I totally agree with your last paragraph. 100%.
But can't you see that what we do have is a situation where women, who are by far the majority of rape sufferers, having had provision (thin on the ground as it may have been), largely as a result of campaigning and fundraising by women. Then men decide that they too want access, and disregard the wishes of the existing users. As ever, women are expected to move along, because 'what about the men?' Men could sort out their own provision, by doing the sort of campaigning and fundraising that women did. Funding is usually far more readily given to male causes than for those affecting women, so it is likely to be forthcoming, particularly as the threat of being deemed 'transphobic' hangs over public bodies thanks to Stonewall. Why is finding solutions for transwomen always a women's problem? I know transwomen think they are women, but they are not, and women are being gaslighted into going along with what is, at bottom, a fantasy.
Dickens, I agree that (whereas provision should, of course, be made for minorities) their needs should not drive policy for the majority, where those needs clash with majority needs. This, as I see it, is an example of one of those many clashes. However, the figures in your link are about sexual orientation, not so-called 'gender' identity, which is very different. AFAIK there is no official record of the numbers of transgender people - up to a point I can see why, as it could be used against them - but it makes conversations like this one difficult, and I firmly believe that that is deliberate. Women also get buried in statistics that also include transwomen.