It had become an iconic location drawing crowds not just for the pool, but also for events and music