There is a worst-case scenario that will be on the minds not just of European leaders but the Labour frontbench too.