Dug up from river banks and construction sites, and containing debris such as ancient glass and fossils, the overlooked local treasure tells tales of place, time and humanity