What an awful prospective neighbour, no one says that in jest, it is not funny. Pulling out may cost a lot of money, that has to be taken into consideration I suppose, but living next door to someone who makes those kind of remarks on first meeting would make me not go ahead with the sale. What else has in store for you, perhaps speaking to the sellers of the house, why are they moving!!
Do you still wear you original wedding and engagement ring