Smith pulls out of governors' meeting in D.C. after mixed reviews for White House visit