The federal opposition has backed out of supporting plans to impose a limit on international university students, saying it would address immigration concerns.