Prince Andrew didn't head to Sandringham to celebrate Christmas with his brother the King and many members of the wider Royal Family.