More than 600 people crossed the Channel in small boats on Friday, the day after a baby died on the journey.