They couple decided to embark on a new life in the country with their young children