A former civil servant known only as H6, was so close to Andrew he was told his “guidance” had helped remove people from the royal entourage.