The actor, 36, said he was affected 'all over my body' as he revealed the challenges he had faced at work