Previously proposed affordable housing on the site has been scrapped