Limiting access could harm Indigenous people, LGBTQ2S+ people and victims of gender-based violence, critics argue.