Turn this scenario around, were your parents the perfect parents? My father certainly wasn't, but then his wife, my mother, died aged just 33, leaving him with four children under the age of ten to raise alone.
It was hellish, he struggled, the stress wrecked his health, but for all that he brought us all to adulthood. He wasn't perfect but he was my Dad, and I will not have a word said against him. My Dad, my hero.
The desire for children of my own never happened, and now at an age when the visit of a grandchild would brighten the hearts of most, I have no regrets to being childless. But I often wonder if my childhood has any bearing on that.