Phillip Schofield admitted there are some channels he won't work for as he confirmed whether he'd make a return to ITV following his exit from This Morning