Prince Harry was once asked how he felt about being pushed down the royal line of succession following the birth of George and Charlotte, and his response was rather sweet