The last monarch to call this iconic palace one of his homes was alive more than 250 years ago.