Major changes are being made at a specialist school following its latest Ofsted inspection.