The Duke of Sussex made a solo appearance at the Grey Cup in Vancouver, Canada on Sunday