Elegran
Drawing a diagram with road names on it - even a very rough one - would have given them a map to refer to, and not involved a voice recording.
However, if you are getting worried about it being recorded for translation, you will soon reach a point where you won't even speak directly to anyone in case they recording you secretly! That way lies paranoia.
You didn't give them your name, address, email address, bank account number and password, or anything else that would identify you or your money, so I think you should put it behind you.
But if they had a sample of your handwriting, the dreaded Artificial Intelligence could extrapolate your signature...
Am I jesting? I'm really not sure any more.
But having a voice recording of a person of unknown name, unknown address doesn't seem much of a problem.