The safeguarding minister warned legislation to tackle violence against women and girls won’t be impactful unless there are sweeping changes at a grassroots level