Fires have torched homes belonging to generations of Black and Latino blue-collar families