The Doctor Who star confirmed the rumours that had been circulating