The Minister says many Congress leaders have recently made critical statements against those who left the party