The swearing-in ceremony, moved indoors due to intense cold, took take place around noon ET