Former Abercrombie & Fitch CEO Michael Jeffries and two other men have been arrested on sex trafficking and interstate prostitution charges, a spokesperson for federal prosecutors said Tuesday.