I was told not to use fabric conditioner for towels as it prevents them from drying effectively so tumble dry mine, even in the summer if they go outside I pop them in the dryer for a short time.
I have the same problem. I don’t want to use the tumble dryer if I can help it. It seems to have got worse over the last couple of years. I wonder if manufacturers are reducing the plastic bits these days and laundry products are not like they were??
My towels tend to dry like cardboard! We have a newish washing machine which is cleaned properly, and use powder and softener, but still have rough towels!