I did not have too much trouble learning to drive, but I found passing the test very difficult. Because I am not well co-ordinated I get very stressed and tense when someone is critcally judging me as I perform manouvres.
I had a lovely driving instructor who who taught me well, but I ended up taling my test 5 times. In each test I made a total mess of one manouvre. never the same one twice: three point turn, hill start, backing round a corner, emergency stop. By the end he said, in despair, that if I failed the 5th time he was going to suggest i saw a doctor and got a tranquilliser for the next one.
One of the tests was on a very hilly course and during it I did lots of 'unofficial' hill starts perfectly, as lots of the junctions were uphill, but when I came to do the 'official' hill start I completely messed it and afterwards the examiner actually said that my driving was fine but I needed to learn to relax and not be so nervous.
Nowadays, I let DH do the test drives when I change cars. i will sit in the car and make sure everything inside suits me, but drive a car with a car salesman sitting beside me, never.