The city has both the lowest and some of the highest unemployment rates in the country, which threatens to exacerbate differences in income and wealth.