The charity is now exploring the possibility of taking up a former children's centre instead