The Archbishop of Canterbury insisted last week he would remain in post