One neighbour said a mother and son lived together at the house and they were 'rarely' seen