If he only puts part of his in the account you could do the same. Did you have the same thing happening when your earnings were coming in - all yours and part his?
If he asks what you spend money on it does sound a bit controlling.
I have never had a joint account, with either ex hubby or my partner now. We just each pay for certain things and share larger amounts. I would always have to have some money of my own, just as OH has (and neither of us know each others balances).
Kate Garroway-Care at home costs
Can You Name 5 More Songs? (number 2)