The residents say they thought they could stay in the homes permanently when they bought them.