Nelly, who performed at an inaugural ball, also saw his streaming numbers dip