Remarks by former taoiseach Leo Varadkar that immigration numbers have risen too quickly in Ireland, have been described as a “new low”.