‘It’s a difficult one to talk about,’ the actor said