Sources said the fishermen left the Karaikal harbour on the morning of January 7