With Prince Andrew not joining the royals for Christmas, Sarah, Duchess of York will also be absent as one royal expert says the King will "sad" not to see his former sister-in-law