Tucked away in the corner of a Grade I-listed town hall, the restaurant is doing something unique