The Alberta government has concerns about contamination and structural integrity at the historic Bitumount site north of Fort McMurray.