Work on a new town centre market has begun in a milestone moment.