It's wise to be cautious. I wouldn't make a harsh judgement on the few details you've given.
By the sound of it the relationship hasn't progressed to a physical one and if only seeing him once a week and both paying there should be no feeling that you owe him a meal or drink etc and have to see him again. I would be finding out a lot more first eg if he told you he has been living in lodgings for 15 years ask about his life for the previous 45 yrs. You should pick a lot up from his answers. Not just the verbal responses but how cagey, avoiding or honest he seems. You also haven't said how long you've known him or where you met. This could give answers too.
Tread carefully but don't judge too early.
Mandelson failed security vetting. Starmer says he didn’t know
What time do you get up and go to bed?

