Police in Banbury, Oxfordshire were left "frustrated" by locals after a stolen motorbike was found in a park.