‘It obviously didn’t do him any harm,’ British actor said