The Tories have accused Labour of 'punishing fans' with tax plans for major venues.