He had a "top secret dinner" while in the city