The latest instalment of the hit ITV quiz show left some viewers far from impressed