The main Opposition party contended that the Speaker had failed to take any action within ‘reasonable time’