Phillip Schofield has been recounting the demise of his TV career in Channel 5's Cast Away - during which he warned "who knows what I'll say" while discussing colleagues he feels betrayed him