I am sorry, but in your position, the idea of whether I was being rude or not, wouldn't occur.
If I was you I would just tell my brother, politely and firmly that, when I rang my mother, I want to be able to speak to her for as long as we both wished and that we cannot do that when there is someone lurking in the background ready to join in at any moment.
I would also do as others recommend and buy her a mobile phone. There are some with limited facilities and big clear buttons designed to be easy to use by older people. www.doro.com/en-gb/products/mobile-phones/ This is one company that does them, there are others. Show her how and where to charge it, in case your brother tries to control her use by making a big song and dance about charging.
But just saying what must be said clearly and politely is really the only way forward.