The oldest professional orchestra in the city will be celebrating its diamond jubilee with its final concert at the end of the month.