The shadow chancellor, who narrowly retained his seat in the election, says he’s unlikely to return to the frontbenches for ‘the next few years, at least’