Travellers have set up camp under a bridge which leads to a town centre.