A housing minister has warned “far too many” buildings remain unsafe, with work to remove dangerous cladding yet to begin at almost 50% of monitored properties.