The president-elect’s aides have grown annoyed by the constant presence of the world’s richest man.