Arch Brexiteer and Boris Johnson supporter was criticised when she was education minister after she appeared to raise her middle finger at protesters outside Downing Street