Police on Wednesday prevented Congress workers from marching towards the Raj Bhavan here to protest against the BJP's policy to "defend" billionaire industrialist Gautam Adani, and its "utter failure" to maintain peace in Manipur.