President met with Japanese prime minister ahead of weekend trip to Super Bowl in New Orleans