Australia's national anti-corruption head has accepted "sole responsibility" for a mistake made in managing a conflict of interest, but won't step down.