Those rejected by people trying to control Parliament: PM Modi