I have lived in Denmark since I was sixteen and still meet people who tell me they can hear I have a British accent.
An accent is nothing to be ashamed of, but the real issue is anyone being told to "Go home where you came from".
I would not ignore such a remark, but tell the person who made it, that I cannot go home where I came from, as it is no longer home, that I am married to a citizen of the country I am living in and paying taxes, and that their remark is rude and hurtful.
I realise that answering in this way may well lead to a mouthful of abuse, but I personally am willing to take that risk in order to show people how rude they are being.
Static caravan purchase is it worth buying
Scottish political mess. Is Devolution working?