Queen Camilla's son has revealed why he is yet to join the Christmas celebrations with the Royal Family at Sandringham.