'The council shouldn't be moving it, they should leave it,' said one local.