Billy Moore said the buildings were 'lovely' but said the town was 'dead'