Yes Aldom, I know what you mean. If it was tongue in cheek (what an odd expression that is!) then perhaps her husband was responding in kind. OP, I wouldn’t take offence, unless of course, he has form for going on about’younger women’.
To me, as I read OP's remark, I thought she was paying her DH a compliment. I can just imagine her sitting opposite her husband, smiling and expressing her pleasure at being out for a lovely meal with 'an attractive, older man'. It's to be noted that OP is a couple of years older than her husband. So also a bit 'tongue in cheek'.
OldScallop I think that your husband may have been responding to the fact that you referred to him as an ‘older man’. It was you who bought age into the equation. I hope that you don’t mind me saying, but I think it was quite an odd thing to say to one’s husband in the first place. Or was it tongue in cheek?