There are about 5% of children who have very obvious learning difficulties or physical disabilities, which without any doubt require special provision.
I seem to recall that 'special needs' children with physical difficulties were, in the past, sometimes effectively ghettoised into 'special schools' for those with the same disability without any regard to their actual ability. It was pressure from parents who wanted their children educated in mainstream, not siphoned off into 'special' schools, which brought about an influx of special needs children into mainstream.
Which was not intrinsically a bad thing, as many children with disabilities such as vision or hearing impairment, or limited mobility, are well able enough to learn in mainstream with adjustments made to accommodate their disability. It was just taken, IMO, a bit too far. Especially with Warnok's fatuous pronouncement.
I'm sure you didn't mean it that way but it almost sounds as though you might support 'resegregation' of children with physical disabilities 