Three celebs have already been eliminated from the competition