'The minister has denied any involvement,' a Cabinet Office spokesperson said