Police are hunting the biker who has been acting "illegally and dangerously" across the Fife town.