Shayne Ward left the competition with partner Nancy Xu just before Blackpool Week