Oooh, I thought it was only me! We have one in the front garden, which silly people kind neighbours think is wonderful! It just annoys me! As you say, it doesn't do much all year, blossoms, then drops pink snow everywhere. To add insult to injury, our is not shaped properly. We had it done 'professionally' a while ago and he made a complete mess of it. Since then DH has had a go, with me directing from the ground, but, while it's good from some angles, it's just wrong from others.
I know there are far worse things to worry about, but this struck a chord with me.
PS The lady opposite has a beautiful magnolia, which she hates and I love! Takes all sorts ... Maybe we should swap houses. Probably easier than trying to dig up the trees and swap those. I have a feeling that ours has roots which extend right under the house! If only I wasn't scared of DG's chainsaw.