Kyle Smith has 'something way worse than what is going around the courthouse'