One White Lotus season three star has responded to criticism over his casting