Duchess of York and her ex-husband, Prince Andrew, will not be joining King Charles and the Royal Family on Wednesday in Sandringham.