Community safety leaders said 'we're doing everything we should be doing', while encouraging workers to challenge people in council buildings