You must be feeling exhausted Beverley6. Please get a solicitor. If your daughter's partner is such a risk they have been ruled out, the fact they both know where you live etc is a risk, but no more than it would be for the aunt and uncle. If their assessment hasn't started, how can they be 'in the lead'.
If the sw report has been written, ask for a copy of it. If it hasn't, do you feel up to phoning the sw and asking them to visit, before the guardian does, so that you are up to date with any concerns the sw has already passed on to the guardian. It sounds as though contact is the main worry. Given the father's behaviour, your daughter's inability to separate from him and the fact you understandably want to support your daughter, it isn't impossible to see where the concerns come from. I think earlier in this thread you said of course you would follow advice, and put the baby first. This is the first time you've been in this situation. The sw and CG will be familiar with many similar family situations, and so have heightened awareness of the possible risks, and the need to make permanent plans for this little baby as soon as is possible. Family Rights Group have a good website with information for kinship assessment/carers. Any good family lawyer would be in a position to give you independent advice, yet act on your instructions. Good luck