A record high of almost 20,000 potential victims of modern slavery were referred into the system last year – a rise of 13% in 12 months.