I think it was rude and disrespectful of him to divulge the content of a phone conversation with the Queen on any subject, let alone one as sensitive as the outcome of the Scottish referendum.
I also think it shows a lack of political judgement to think it was appropriate to make any allusion whatsoever to the Queen's response, knowing that she has to appear impartial and is unable to give any response to his remarks.
And to cap it all, I think it is extremely patronising for a man to refer to any woman 'purring' about anything whatsoever. So all in all, I think he has made a right prat of himself and shown his attitudes to women - perhaps older women in particular - to be extremely questionable.