Councillors said the delay will affect girls and women's football in Wales' largest town