Multiple cracks in the walls of a Grade II listed building have left it unsafe