‘I worry about myself in the mirror as I age,’ the actor said