We do intrude on one another all the time, as you say, Chiatriona. The difference is that some noises are impossible to control - off the top of my head, church bells, aeroplanes, passing trains, traffic - but others are inflicted on us, such as screaming (not just playing) children, barking/yapping dogs, balls bouncing on walls, loud music, whether from cars with open windows, scaffolders or people playing music in their gardens.
It is the latter group that cause annoyance, as the people making the noise could simply not do it, or take the trouble to teach their children or train their dogs not to do it. Lawn mowers/leaf blowers etc can be used late morning/early afternoon where possible, to minimise the chances of spoiling anyone's lie in or early night.
It's not difficult - yes, we have to live our lives, but we can consider others whilst doing so. On the odd occasion where we have to make noise (building work or similar) most people will be tolerant if it is kept to a minimum otherwise. I think it's as much the lack of respect as the noise itself that's annoying a lot of the time.