'Even if everything was rosy and there was no risk, we’ve given up any down-stream autonomy in pursuit of a less capable system.'