John Swinney refused to say whether failing to reduce child poverty rates would be considered a failure of his government.