Several caravans have moved onto the fire-hit site