Our situation is very similar to yours Shropshirelass. Our GC know of our existence as they've asked our DS about us in the past, but they have no memory of us and are unlikely to have.
Even if we'd wanted too, we couldn't have pursued a contact order through the courts as we've never had a constant and meaningful relationship with our GC.
I agree that going to court can create upset and confusion for the children but so can suddenly being unable to see the GP's they've come to know and love.
There are some AC who manage to preserve the relationship their children have with their GP's despite any issues they may have and I take my hat off to them.