Health Secretary Neil Gray must publish all minutes from meetings he attended at football matches he was driven to in a Government car, the Conservatives have said.