I assume it is not the person who owns the house abroad and who very kindly offers it to family and friends to stay in who made the comment about "working very hard". I assume it is the OP who said that and I agree that it is rather an annoying comment because, as has been said, lots of people work very hard in difficult jobs but they never get much for their labour.
As for people sometimes feeling jealous, I admit to occasionally feeling a bit jealous of some things, and I would be very surprised if I am alone in that. I agree it is an unpleasant and irrational response that should be resisted but we are not all lovely, rational people all of the time.
I agree with Iam64 that Whitewave did not deserve such criticism for her brief remark.