The immigration minister has swiftly imposed freedom restrictions on former detainees but there are concerns about whether they'll withstand a court challenge.