My MiL in the NE and my aunt in Scotland called me 'hen'. My DM calls my OH 'bach'. I've been addressed as ducks, dear, dearie, darling, sweetie, mate, ma'am, missus, and all sorts of other things depending on where we are in the world. Really doesn't bother me in the slightest.
I do dislike hun, simply because it makes me cringe, and oi is just rude.
If someone is deliberately being rude that's different.
I wonder, would you have been so offended if the person calling you 'sweetie' wasn't an ex-offender?