Viewers were concerned the doctor was too "gullible"