The comparison was always just a left-wing smear