The construction of 70 new homes on a former medical site is set to begin in November despite some residents complaining about noise from ongoing demolition work.