A passing off-duty police officer jumped into the water to save the man