It’s now clear why he didn’t join Marvel co-stars for Kamala Harris endorsement