The visitors took the lead within the first two minutes of the game