Prue Leith opened up about a "grim part" of her life to Gyles Brandreth, who recounted meeting The Great British Bake Off star at a restaurant in the early 1970s, accompanied by a "charming" date