The monarch, a proud grandfather to five, is known to spend a lot of time with his three eldest grandchildren and three other lesser known royal children.