The Scottish Secretary said his party had always been upfront about the challenges facing the economy