Of course there's a middle ground. I suppose it depends on the age of the children, but if they are of screaming age, which is usually very young, someone in the group's parents should be able to see them, or they should be in earshot. Mine played in the garden, and obviously weren't silent; but I did not allow screaming. I would warn them if it happened, then they had one more chance, and if they did it again they were brought indoors. Children are not going to play quietly, but if they are brought up from the start to recognise that there are other people to be considered, they can learn to keep the noise down to sensible levels, and by 8-11 they should definitely be able to do so without adults telling them.
I don't think it's being miserable to want a bit of peace in your own home, and whereas I also enjoy hearing children's laughter, screaming is really annoying. Also, in any residential area there will be people with different things going on in their lives. Shift workers, people with babies, people who are sick, insomniacs - all of these people have a right to use their homes as they need to, too.
As an aside, I don't understand why some people demonise screens so much. Yes, children need exercise, but there is little difference between playing on an iPad and reading a book as far as that is concerned. A lot of gaming is interactive, and can teach interpersonal skills, as well as being educational in many cases.