For me, it is not so much that you take your shoes off but that you consider where you have been before you enter my house. So, if you have been for a long hike on a muddy winter's day and then come in for a cuppa, I would expect you to remove your boots/stout shoes out of respect for entering my home. If however, it is a fine day and the ground is dry and your shoes are everyday wear, I would not expect you to take your shoes off. Elderly relatives/friends who have trouble bending to take off their shoes won't, most probably, not have been out hiking/walking in pooey areas and so won't be bringing in all sorts of dogs'/cow/horse/field deposits into my living areas. It is also about having manners from the guests as well as setting an example by showing a shoe rack/corner on entering your home. I am not obsessive but do respect my and other people's daily living areas.