The former Olympic champion has spoken about his "toughest year"