You are only a hoarder if you have wardrobes, and suitcases, full of clothes you no longer wear, although 20 pairs of summer trousers seems a little excessive. When I retired I had 50 T shirts, but I wore them throughout the year, under shirts, cardigans and jumpers, and some were 15 years old. I don't have distinct summer/winter clothes, just layer.
I have far fewer clothes now, mainly because I spend most time dressed down, village life I think, and partly because I like shopping for clothes in shops so I can see the colour, texture, feel, of a garment before I buy. Now there are far fewer shops I am not enticed into spur of the moment purchases, plus the fact I tend to go shopping with a friend (shared lifts) who just as I am considering the 'what will it go with/can I afford it' calculation will say, goodness, have you seen how much this costs or are we going to be much longer because I am worried about the carpark?