The Black Cats will not rush the defender back