'A prime minister committed to true reconciliation would have removed Randy,' said former Liberal cabinet minister Jody-Wilson Raybould