Shuffle sparked by multiple departures comes as NDP vows to take down the government