A man has been taken to hospital after falling from a wall and into the sea.