'We can't simply heap more misery on local residents,' one councillor said