I had someone living at the back of my house who did that non stop, I hot quite angry about it, and one day I confronted him because he really was an unpleasant character, only he gave me a load of abuse, and then never stopped calling me names whenever I was out in my garden. Only the peeping around curtains and standing in his window staring into my house all the time just got worse, I kept my curtains drawn all the time, and I hated going out into the garden, his greenhouse was built into my boundary fence, so he'd just sit in his greenhouse staring through his glass which was effectively in my garden, I put a six foot fence up which he complained about at it blocked the light in his greenhouse, but legally there was nothing he could do about it, so he'd stalk me just so he could become abusive, his wife then started to join in. I didn't make things any easier because I did used to argue back, but it just added fuel to the fire, in the end I sold up and left, I hated living on tenter hooks all the time, it really freaked me out. This chap had a nasty temper, his wife was no better, but as I said, I couldn't keep quiet and let them walk all over me, they needed to know I knew they were spying on me. They denied it, which was absurd, he was always there staring straight at me, any time day or night, it just didn't stop.. My children were very small at the time too, that's why I moved, it just didn't feel right.