The impact goes well beyond job losses, writes Jamie Rowen