From a labourers’ village, to the hope of a state-of-the-art residential complex and then despair - the changing face of Eldon Grove