A wider picture of spiralling migration is making Labour and Tory strategists fret