A dog walker has found a suspected unexploded ordnance off a public footpath.