The couple said it was a "huge job" turning the property into a five-storey family home