Michel Barnier drove a hard bargain in Brexit negotiations, infuriating Brexiteers during a time of tense relations with the EU.