Actor previously apologised for working with the director in 2019