His latest memoir is awash with anecdotes of globe-trotting charity and cosy fireside chats with world leaders