'When we got world heritage status in 2000 there was a lot of excitement, but it didn’t bring the prosperity people thought it would. We thought it would bring lots of people into the town but it never really has.'