Grandads can have great influence on their grandchildren, and making the effort brings huge rewards as the children grow. We had our two grandsons from 1 year old to school time, for 3 days a week while Mum worked. They were such a joy. Lots of reading, lots of games and learning through play. Now 13 and 16 they have been fluent readers for years, and are well brought up young men.
Of course, much of this is down to parents, but they are turning out to be nice people, and we have played our part in that.
They are pleased to see us when we visit (not lately though), and very spontaneous with the hugs. Yes, even the 16 year old!
Perhaps tell your husband he could be a role model, and help bring your grandchild on, be a positive influence in his life?
And if he can't, you can, and you will reap the later rewards.
Good luck. Lots of positive stuff in other posts.