The former prime minister has dismissed claims the late Queen called him an 'idiot' just two days before her death.