The Little Hallam Hill site would have become home to 26 affordable houses