The seven-bedroom house was once owned by the 'father of the village'