Scores of residents have signed an objection letter