Absentgrandmother, from your comments:
'All the houses are owner occupied'
and
'I can not install anything here on the common parts'
- along with mentioning a 'buzzer' I assume that you live in a flat. It's good that you have a camera and you may wish to review the security of your door and windows.
Apart from that, and reporting him - I'd ignore him completely. He's looking for a reaction - don't give him one - or display any signs that you've even noticed him - if at all possible.
As you've escaped an abusive situation, please realise that you're hyper-vigilant, on red alert - so may well be overreacting to the local 'difficult' neighbour - who probably poses no threat whatsoever to you.
If you're in the UK, check whether there's a local 'Nextdoor' forum in your area (where you can PM close neighbours). Otherwise, enjoy your new home, get on with your new life - and just ignore this man.