'I think it is only right that cabinet members are held to account'