The coastal town of Ledge Point has been spared from a bushfire that came just metres from destroying homes and a local caravan park.