Plans for a new self-build house in an Oxfordshire village near Abingdon have been approved despite concerns from a parish council.