My advice is do exactly what you are doing , and be very careful about not letting your feelings show, their mum will always be their mum, no matter waht passes under the bridge.
It is very normal for children to want to be with the 'absent ' parent, and can get themselves very confused - this can be due to the fact that rules are relaxed when away from the main care giver . The family courts usually say that around 10 is the age when a child's opinion should be sought.
We had a very mixed up muddle - I had 2 children, he had 2, then we had one between us, his 2 stayed over every weekend, one weekend Saturdays only, as my ex had my boys that sunday, then the nest week we would have them over Saturday night and all day sunday.
My ex had 2 more kids, so my boys have 2 half brothers,plus a step brother and sister, and my husbands ex had another little girl.
We have seen all of the various playing each other off against each other permutations you could wish for - and luckily, with the exception of my husbands ex's parents( who wouldn't even speak to my 2 year old daughter at her 1/2 sister party! ) , all grandparents involved , of all of them, kept their counsel, included all the various 1/2 s and steps in with celebrations, and all have ended up pretty well adjusted adults, and friends with each other