Prince Andrew and his ex-wife Sarah Ferguson will no longer be spending Christmas at Sandringham, it has been reported.