Former prime minister’s memior claims he was asked to convince Prince Harry to stay in the UK