The multimillionaire said 'it's nothing to do with me'