The man 'walked directly towards one referee and shoved him with enough force to knock him onto his back'