I agree with Baggs' suggestion in general, because I experience it from the opposite perspective. I am represented at all levels of government by a Conservative, although I have never voted Conservative in my life. I would estimate that approximately 40% of locals are in the same situation.
Until now, our Conservatives have been fairly middle of the road. There are plenty of grumbles, but the fact that we don't even have a local Labour Party shows that people aren't on the verge of revolution.
Since the last election, we have a Conservative with quite extreme views and I've never known so many local progressives come out of the woodwork. We really don't feel that we are represented by an MP who has been parachuted in and really has no understanding of her constituency. Nevertheless, over half of the constituents are life-time Conservative voters and probably voted out of habit and because anybody else would be too extreme.
So turn that round...
I have no idea whether Luciana Berger is a good constituency MP, who listens and acts for her consituents. I know Liverpool Wavertree and it's the reverse of my constituency. The sky would fall in before people would vote anything but Labour, so they don't have much of a choice. They would vote Labour, however "hard left" the candidate is, even if they didn't agree with everything being suggested. There could eventually be a backlash, but it would take time to get an alternative organised and a great deal of damage could be done.
If word from street level is that people are dissatisfied with Berger, maybe a replacement should be considered, but not by somebody who fits the ideological stance of the national party, but isn't responsive to local concerns.