It is claimed the the building is unsafe and has been attracting anti-social behaviour.