Kate's paternal family has ties to the textile industry