The state of the economy is “disappointing” and people’s frustrations with Labour’s performance in office are understandable, a Cabinet minister has acknowledged.