Locals have claimed works on the expansive Swansea to Monmouthshire route has caused financial decline, and created "hell" for the communities it has been built around