If it were a loving, equal relationship that you both definitely want to continue and neither of you have any children, then I would have expected that you would have been able to discuss all aspects of the future, including finances.
The fact that he loses his temper when you want to discuss it does ring alarm bells. Do you have any knowledge of how much he has in savings or whether he is spending it on anything else? Have you made wills and are you each other's beneficiaries?
If I've understood you correctly, you have been partners for a very long time, but only lived together after his parents died and he didn't have his own house to go to. If you were content not living together all these years, is living together something you really want now?
Legal advice is definitely needed and a good think about what you are getting/what you want out of the relationship. Are you just friends/companions and is he taking the mickey financially?
If you feel trapped or not in control or are not sure what you want, some sessions with a counsellor might be very helpful. There could be financial/emotional abuse going on or he might just not know what's normal/fair in terms of finances having lived with his parents for so long. He might be scared to contemplate being responsible for a house either on his own or jointly with you, possibly hasn't a clue what's involved, and gets angry rather than admit these fears?
One option would be for him to buy a house and you could work out ( without any pressure) whether you want to live together all the time or not. If you do want to live together, one house could be let out. Advice should be taken on such things as whether each of you wants to leave the other their house in a will, whether either of you could have any claim on the other if you "fell out" etc.
Good luck. Take control and have the courage to have the future you want - whether together or apart or somewhere in between!