“It’s pretty hard to plan exactly the day, but definitely [I might miss the tour],” he said