A baby has drowned after a boat carrying migrants towards Britain off the French coast capsized, the local coast guard said on Friday.