TV auctioneer Charles Hanson’s wife had a “frightening” reaction before accusing him of physically abusing her, he has told a court.