Shayne Ward said he had an “amazing time” with the “beautiful” Nancy Xu