I still do Christmas lunch (and tea) but I enjoy it. If you are not finding it enjoyable, (and it sounds like you’ve had enough now) I would say so. It’s early enough in the year to head off any family expectations, and for them to make other arrangements, which would hopefully include you.
My mum always used to do Boxing Day, once our children got older, but announced some years ago she couldn’t cope with it, so 2 of us take it in turns to “host”. The other sister doesn’t, but we know she doesn’t have the space, and simply couldn’t get us in.
If an invitation isn’t looking likely, in your shoes I would be a bit hurt too, but I would look for a nice hotel or holiday, and have the sort of day I wanted.