“At what point does Trudeau go, ‘maybe I’m the problem,’” said Mount Royal University political scientist Duane Bratt