Actor recalled his father threatening ‘to blow my brains out’