Crowds gathered close to the police cordon to watch as flames ravaged the roof of the town hall