A major Oxfordshire road will be closed overnight near Oxford.