The Pointless star has revealed some surprising information about the show