The rapper also claimed Trump’s Secret Service agents were giving everyone at the game a ‘hard time’