Swimmers braved the early morning chilly conditions to take part in the Rottnest Channel Swim.