Former comedy partners now ‘don’t see each other that often anymore,’ Key admitted