A man who ended up in the chilly waters of Poole Harbour was taken to hospital.