Opposition leader Peter Dutton said the influx of new residents to the country vying for accommodation was why the price of housing remained at record highs.