A bushfire that has destroyed a home and damaged rail lines is slowly moving towards a remote town despite the tireless efforts of fire crews.