Former England cricketer Matthew Hoggard says his life was “ruined” by the Azeem Rafiq racism scandal.