A former royal butler has revealed one meal time difference that left a young Prince Harry asking questions.