Two CFMEU members have been thrown out of a building convention moments before a major plan to pause pro-union practices was announced.