OXFORD United cannot afford to focus too much on Middlesbrough creator Finn Azaz, says head coach Gary Rowett.