It was expected to be the biggest swim in 14 years, but people still went home soggy due to a change of plans