A whale shark has left tropical waters to make a rare appearance off a town on the NSW South Coast a few hours’ drive from the Victorian border.