Prince Harry stepped down as patron of Sentebale last week, a decision that did not come easily for the duke.