- Foundation
- About 18 min
- 5 practice questions
Designing a questionnaire
Learn how to prepare a questionnaire or interview schedule, avoid common faults in questions, and choose between closed-ended and open-ended questions.
If something looks wrong, please tell us.
By the end of this lesson you can
- List the points to keep in mind while preparing a questionnaire.
- Spot and correct faulty questions (leading, ambiguous, double negative).
- Compare closed-ended and open-ended questions.
A survey is a method of gathering information from individuals. Manufacturers use surveys to learn what buyers think of a product's price, quality and usefulness; others use them to judge opinion about people or ideas. The purpose of every survey is to collect data, and the quality of the data depends heavily on the instrument used.
The instrument: questionnaire or interview schedule
The most common survey instrument is a questionnaire (or interview schedule). It may be self-administered by the respondent, or administered by the researcher (enumerator) or a trained investigator. The person answering is the respondent.
Rules for good questions
| Rule | Faulty question (made up) | Better question |
|---|---|---|
| Keep it short: as few questions as possible | A 70-question form for a 5-minute street survey | Only the questions needed for the purpose |
| Easy words, no difficult or ambiguous terms | Is your household's fuel consumption elastic? | Did your family buy less cooking gas when its price rose? |
| Move from general to specific | Is the new bus fare justified? (asked first) | First: Do you use the city bus daily? Then: Is the new bus fare justified? |
| Precise and clear | What share of income do you spend on food to stay healthy? | What share of your income do you spend on food? |
| Not vague; give ranges to tick | Do you spend a lot on mobile data? | How much do you spend on mobile data in a month? Less than ₹100 / ₹100-200 / ₹200-300 / more than ₹300 |
| No double negatives or 'Don't you...' openings | Don't you think plastic bags should not be allowed? | Do you think plastic bags should be banned? |
| Not leading (no clue to the answer) | How do you like this delicious new biscuit? | How do you like this biscuit? |
| Do not suggest only certain alternatives | Will you study further or start working after school? | What do you plan to do after school? |
Questions should also be arranged so the respondent feels comfortable, and they should let him or her answer quickly, correctly and clearly. Questions beginning 'Wouldn't you...' or 'Don't you...' tend to produce biased answers because they push the respondent towards agreement.
Worked example 1: repairing a faulty questionnaire
A made-up survey on a school canteen contains: (i) 'Don't you agree that the canteen's tasty food is overpriced?' (ii) 'Do you eat at the canteen often?' Step 1, find the faults: (i) uses a 'Don't you' opening, is leading ('tasty') and combines two issues (taste and price) in one question; (ii) is vague, because 'often' means different things to different people. Step 2, rewrite: (a) 'How many days a week do you eat at the canteen? 0 / 1-2 / 3-4 / 5 or more'; (b) 'How would you rate the canteen's prices? Low / Reasonable / High'; (c) 'How would you rate the taste of the food? Poor / Average / Good'. Step 3, order: the general question about use comes first, then the specific ratings.
Closed-ended and open-ended questions
Types of questions in a questionnaire
-
Closed-ended (structured)
- Two-way question: only 'Yes' or 'No'
- Multiple-choice question: more than two options, often with 'Any other (please specify)'
-
Open-ended (unstructured)
- Respondent answers in own words
- Example: What is your view about online classes?
Strengths and weaknesses
-
Closed-ended
- Easy to use, score and codify for analysis
- Hard to write: options must cover both sides of the issue
- The true answer may not be among the options
- Options can restrict or shape answers
-
Open-ended
- Allows individualised responses
- Hard to interpret
- Hard to score because answers vary a lot
Closed-ended questions are easy to score but may miss the respondent's true answer; open-ended questions capture it but are hard to interpret and score. The 'Any other (please specify)' option is a bridge between the two.
Worked example 2: writing a multiple-choice question
Task: write a closed-ended question to learn why made-up farmers in a village stopped growing a crop. Step 1, decide the type: more than two answers are possible, so a multiple-choice question suits better than a two-way question. Step 2, write options that cover the likely reasons without overlapping: 'Why did you stop growing sugarcane? (i) Not enough water (ii) Low price for the crop (iii) High cost of inputs (iv) Shortage of labour (v) Any other (please specify).' Step 3, check: the options are clear and separate, and the last option catches answers the researcher did not anticipate. A two-way version would be 'Did you stop growing sugarcane this year? Yes / No'.
Key takeaways: a questionnaire should be short, simple, ordered from general to specific, precise, unambiguous, free of double negatives, not leading and not limited to suggested alternatives. Closed-ended questions (two-way or multiple-choice) are easy to score; open-ended questions give richer but harder-to-score answers.
Check your understanding
-
1. 'How do you like the taste of this premium-quality juice?' is a poor question mainly because it is:
- too short
- open-ended
- a leading question
- a two-way question
Show answer
Answer: C. The words 'premium-quality' hint at how the respondent should answer, which makes it a leading question. A better version is 'How do you like the taste of this juice?'
-
2. A question that can be answered only 'Yes' or 'No' is called a:
- two-way question
- multiple-choice question
- open-ended question
- pilot question
Show answer
Answer: A. A closed-ended question with only two possible answers, yes or no, is a two-way question.
-
3. Which is the correct order of questions according to the chapter?
- Specific questions first, then general
- Random order to keep respondents alert
- Only specific questions
- General questions first, then specific ones
Show answer
Answer: D. A questionnaire should move from general to specific, for example asking whether supply is regular before asking whether a price rise is justified.
-
4. A limitation of closed-ended questions is that:
- they are hard to score
- the respondent's true answer may not be among the options
- they cannot be codified
- they always produce biased answers
Show answer
Answer: B. Closed-ended questions are easy to score and codify, but the true answer may be missing from the options and the options may restrict answers; that is why 'Any other' is added.
-
5. Assertion (A): Questions beginning with 'Don't you think...' should be avoided. Reason (R): Such questions may push respondents towards a particular answer and give biased responses.
- Both A and R are true, and R is the correct explanation of A
- Both A and R are true, but R is not the correct explanation of A
- A is true, but R is false
- A is false, but R is true
Show answer
Answer: A. Both are true, and R explains A: a 'Don't you think' opening nudges the respondent to agree, so the responses become biased.
Sign in to keep track of the lessons you finish.