One opponent said 'enough is enough' amid fears over 'unsustainable location