Scores of party workers, former ministers, and senior leaders joined the march in different states