Opposition leader Peter Dutton has taken a swipe at Prime Minister Anthony Albanese over a hotly-contested issue affecting millions of Australians.