I still haven’t put the tree up, although I have put out all the smaller bits I decorate with. (and there aren’t masses of those). For the first time in about 30 years, I’m not doing Christmas Day lunch, so with no children visiting, I’m struggling to get motivated. I do have relatives coming on Boxing Day, so will have to do it, but I don’t think I’d bother otherwise. My OH probably won’t even notice.
I would do whatever you feel like, and take the opportunity to have a day to completely please yourself. A few small bits like a garland a mini tree and candles are easier to clear away, and help mark the season if you want to.