Embattled Mineral Resources boss Chris Ellison has reportedly started paying some of the financial penalties slapped on him by the board over a tax scandal.