The remaining fishermen were handed over to local police, with Sri Lanka`s Department of Aquatic Resources reportedly denying responsibility for arrest