Goyal's visit was sudden, as he departed after cancelling previously scheduled meetings until March 8