A man assigned to a newcomer family is alleged to have sexually assaulted the victim on three occasions, police say