They broke up shortly after he exited this year's dance competition