Prince Andrew has been spotted in public for the first time following his connections to the alleged Chinese spy.