The actor was removed from the film without warning