The former Spurs boss expressed a desire to one day return to the club