It's understood close family members and allies have become increasingly fed up with his "clingy" behaviour.