The arrangement will be in place for the "foreseeable future" after structural issues at the nine-year-old school building were uncovered