The former Tory MP was speaking at the premiere of ‘Meet The Rees-Moggs’ in London