The head judge came under fire after her vote sealed the fate of Shayne Ward and Nancy Xu