The US president was meeting the Prime Minister in the Oval Office