The former Prime Minister disappeared from the show during a break, with presenter Krishnan Guru-Murthy revealing he had been booted off for 'banging on about his book'