The property was once where Lord Snowdon and Princess Margaret would escape to