A Worthing road has closed following a pipe leak.