Alison Hammond and Dermot O'Leary were not impressed after being left out of the action while Jeff Brazier jetted off to New York to cover the latest ITV competition