Former presidents declined to attend Trump's inaugural lunch despite invitations. The inaugural luncheon tradition dates back to 1897 and symbolizes bipartisan support for the new administration.