Concerns have been raised that a historical area of Hartlepool is in "danger of having its rich heritage disregarded and disrespected" by a new housing development.