‘The idea that he might have the audacity to bring a casual partner on stage at the inauguration has been described as a potential misstep,’ family friend says