Fans thought one player had a disadvantage on the quiz show