Question Design: Don'ts
Double-Barreled Questions
Section titled “Double-Barreled Questions”Two assessments in one question.
Avoid
How satisfied are you with the price and quality?
Better
Split price and quality into two separate questions.
Mixed-Level Answer Options
Section titled “Mixed-Level Answer Options”All options should be at the same level of abstraction.
Avoid
Which feature do you like? Feature A / Feature B / I don't like this product
Better
Separate the feature preference question from a general attitude question.
Loaded Questions
Section titled “Loaded Questions”Embedded value judgments bias answers. LLMs are particularly susceptible.
Avoid
How much did you enjoy our award-winning service?
Better
How would you rate your most recent service experience?