It was women who drove his art to its heights – and women who bore the brunt of his callousness and ego.