This was me two days ago, we have been doing major hedge-cutting and I came into the kitchen hot and tired knowing I had to get lunch together, to see him sitting at the breakfast bar with his ipad, still in mucky shoes and covered in goosegrass seeds and leaves and twigs, with stuff all over the (previously) clean floor. I lost it too, because I was tired.
So he went outside and stripped right off down to his underpants.
He was apologetic, though.
You can't tiptoe around him, though. Surely he would rather lead a normal life and be treated normally, than be reminded of his frailty for you not being your usual practical and justifiably annoyed self.