Residents say the council planning committee ignored their views and gave the green light to a heavily objected block of flats.