Personally, I think it’s the other couple, stirring.
The very same thing happened to me. I was very, very, friendly with a couple ( previous neighbours). When I moved following my divorce, the husband did my garden and odd jobs. Ofcourse, I paid him. I used to do them a brunch, every Saturday, after their weekly shopping trip to Asda,( near me). Whenever I went down their side, for whatever reason, I always popped in and had a cuppa. I did notice, however, every time I went there, their neighbour came in. Basically, she’d see my car, and no sooner had I sat down, she would follow.. I even began to doubt whether my friend actually liked my company or not and had told this lady, everytime she saw my car, she should come in.
Anyway, her husband passed away, and other than going to the funeral, I have no contact with her. This other neighbour has definitely said something to alienate me. I truly believe it.