King Charles has only seen his two youngest grandchildren a handful of times since they were born, but he is hoping to spend more time with them in the future.