Trump refused to participate in inauguration day traditions four years ago, having refused to concede the 2020 election to Trump