The actor said "It's like saying goodbye to your life"