The far-right party has made gains without seeking to moderate — rattling Europe and its largest democracy