'There was no violence or threat of violence and, really, this was no more than banter between opposing supporters, particularly in a derby game'