There are fears the move could "risk jobs" and deter visitors, according to critics.