South Wales Police said they are investigating what happened and want to "reassure" the local community