Actor’s comment was branded ‘the roughest thing you could say to a director’