Prince Andrew will not be joining King Charles and other members of the royal family at the annual pre-Christmas lunch in Buckingham Palace this week