Mr Smith argued last week that the policy should be "recalibrated" - but previously voted for the plans