The minister argued there was a lack of ‘fundamental change on the ground’ when the Tories were in power.