A former minister has described his party’s failure to deliver on its Nairn bypass commitment on time as the “granddaddy of all undelivered Scottish Government pledges”.