If only walls could talk, The Old Rectory might just reveal secrets no historian has ever uncovered