Councillors said there was "no way" they could support the plans for the new homes