The vaulted ceilings and stained glass have given me a frisson halfway between glamour and gravitas