Prince Harry said he and Meghan Markle were "nervous" to see members of the Royal Family on one particular occasion.