Police said the pursuit went from Corporation Street to Church Street yesterday afternoon