A Place in the Sun viewers watched the awkward moment the buyer shut down the tour, telling host Jasmine Harman he didn't want to bother seeing the rest of the house