I'm not ashamed to be British, either, and I really loathe the term 'Little Englander'. The sort of people who use it, and like to sneer at their compatriots, would not usually dream of sneering at any other nationality showing any shred of patriotism, be they French, Spanish, Welsh, whatever. It often stems IMO from a feeling of guilt/shame about our imperial history, but other European nationalities had empires, too, and don't feel they have to beat themselves up forever about them.
Denigrating one's own country is a peculiarly English thing IMO. And anyone who's been around the world at all, or just around Europe, will be aware that racism occurs all over, and is frequently more generalised than it is here. Just for starters I know someone married to a black African woman who used to live and work in Spain - he said the racism suffered by his wife there was far worse than anything she's ever met in the UK. The French are not exactly renowned for their natural love of diversity, either. Of course it's wrong and nasty wherever and whenever it occurs but anyone who who thinks it's particularly bad in the UK is just naive.