A vocal critic of Donald Trump has taken a swipe at the incoming president before leaving the Senate with his moderate brand of conservatism now on the outer.