The sports broadcaster, speaking on his podcast The Rest Is Football, said it 'makes sense for someone else to take the helm'