‘Quite frankly, that’s bulls***,’ the ‘Daily Show’ host said