There were 39 letters of opposition to the plans for the building in Llewellyn Street