Construction will start soon on dozens of new houses near a brick works and quarry site in Bexhill.