A man will remain in custody after allegedly hurling anti-Semitic abuse at a woman while he was living in Jewish-run crisis accommodation.