The former home secretary said he would return to the backbenches regardless of who won the Conservative leadership election.