Welsh Conservatives have been accused of having “given up”, after the party leader missed a vote on the Welsh Government’s draft budget to go to the US.