Sam Allardyce recalls "one of the hardest things" he had to do during his time in charge at Wanderers