‘Only for your protection,’ the actor said