The dancer said he and Amanda Abbington "never had an argument" during their time on Strictly Come Dancing as he addressed the scandal