Travellers have been spotted setting up camp in the fenced-off Kimmerfields business district in Swindon.