But a leading Labour councillor has hit back at the criticism