Fans took to social media to complain about the treatment of The Traitors star after he was eliminated