There is little doubt that Brexit has weakened loyalties