Drew Pritchard is racing against time to complete the restoration of his dream Georgian townhouse and says spending millions on the project was "really difficult"