The head judge has hit back after viewers criticised the judges following Sam Quek's exit
