The Duke of Sussex, 40, has spoken fondly about his time at the home.