The Traitors fans were upset over the latest contestant who was banished from the game