Cannot say just batters have let us down: Gambhir