Peter Dutton has doubled down on an Australia Day election promise, claiming the PM had signalled to councils the day is “something to be ashamed of”.