Viewers shared their confusion on social media over why the pair were ruled out of the public vote