The justice ministry needs “new energy” after 14 years with a Fine Gael minister at its helm, Jim O’Callaghan has said.