A move to replace oversight of applications with a committee rather than a judge is galvanising opposition