The Braemar Lodge Hotel was demolished after a blaze and neighbours have bemoaned the flattened site being left empty ever since.