A yellow cold health alert has been issued for the Oxford area.