Carter's time in the White House has always played second fiddle to his post-presidency accomplishments