The Witcher actor arrived with a member of the Royal Family on Gold Cup Day