A road in a Monmouthshire hamlet has been closed for urgent repairs to a burst water main.