There is absolutely nothing wrong with you for not wanting caring responsibilities. You say you don’t mind babysitting for nights out or illness and I think that is very kind and generous of you, your family should be very grateful for that. It sounds like you are fair, reasonable, assertive and boundaried which is something many on here myself included could take note of.
Am I the only Granny who doesn't want to have caring responsibilities? It feels like I am. I don't mind babysitting for nights out or illness. I just don't want to do regular duties that are parents responsibility.