The Royal couple spent two years living in a secret home