Owen Hatherley on the refugees who revolutionised the country’s visual culture