I work for a small business that generates a "good" amount of money. Fraud is everywhere - absolutely everywhere! I've had two significant occurrences in the last 6 months that could have had appalling consequences for our company, not only monetary but in reputation.
As one who forgets passwords and such I know it's an awful bind, but honestly these measures are in place for a terribly good reason.
There are numerous stories in the press, but one that my parents told me some 20+ years ago. They had friends, an elderly brother and sister, who lived in a small community. A workman came to the door to offer his services for any little jobs they might have, extremely friendly, very chatty, and they were delighted with this new "friend". Robbed them while they weren't looking. They were too embarrassed to tell the police until my parents (both then in their 70's) insisted they do. They'd invited this fellow into their home, made him welcome! The knock-on effect was they both became extremely depressed and enormously unhappy.
I think it's great that banks and building societies have this safety net in force.