There is evidence that people have been “in and out of that building over a number of years,” says Victoria Fire Chief Dan Atkinson