After a picture-perfect start on Sydney Harbour on Thursday afternoon, the fleet was braced for increasingly brutal conditions early on Friday morning.