The derelict site is within a town's conservation area.