The Commons Leader said voters would judge Labour on whether they feel better off and have improved public services at the next election.