I think many posters on here forget that the relationship between children and their parents and those same children and their grandparents is very different. I mentioned on a separate thread that whilst I loved my grandmother I was aware that she was not that keen on my mother. I think it was to do with the fact that my parents had me when they were 21, followed by 3 others over the next 7 years. My grandmother did not approve. However, for me she was everything I think a GM should be and I am forever grateful for that. One of the things that GPs have to give is time. I watched my Father with my niece when she was a toddler. He had time and patience to spend with her.
If Maternity Leave is only going back to work for 3 days, why, during the other 2 days, can't you take your childearound to his grandparents and leave him there for an hour or so, at the time of day when he isn't normally tired?