Industrial action being taken by criminal barristers in Northern Ireland is causing “serious damage”, the Stormont Justice Minister has said.