Lord Grimstone has broken his silence