A road in a village in Monmouthshire has been urgently closed to repair a leaking water pipe.