Prince Andrew's annual "living allowance" worth $A2 million has been withdrawn by King Charles, according to reports.