The comedian explained even he "has a line"