The former Celeb SAS star said his son was 'extremely upset'