Many do not want it to become 'an empty building'