Former Tory chancellor says new report shows harm to exports is 'exaggerated' - but expert hits out at 'selective evidence'