Concerns have been raised about disruption to the Cheltenham Festival.