Opposition Leader Peter Dutton has compared the PM’s proposal for longer terms for government to the Voice referendum, labelling it a “desperate” thought bubble.