Australians must be prepared to listen to each other if they want to have a serious conversation about the country's national day, Indigenous leaders say.