Andy Dixon of 55 Fisheries said Brexit "hasn't worked out as the Government promised", with his industry continuing to be hit by huge costs