- Foundation
- About 18 min
- 5 practice questions
Modes of data collection and the pilot survey
Compare personal interviews, mailed questionnaires and telephone interviews, choose the right mode for a situation, and explain why a pilot survey is done.
If something looks wrong, please tell us.
By the end of this lesson you can
- Describe the three basic modes of collecting survey data.
- Compare their advantages and disadvantages and choose a suitable mode.
- Explain the purpose of a pilot survey (pre-testing).
Once the questionnaire is ready, it has to reach the respondents. The chapter describes three basic ways of collecting data: personal interviews, mailing (questionnaire) surveys and telephone interviews. Online and SMS surveys are newer forms of the same idea.
Personal interviews
The investigator meets respondents face to face. This method is used when the researcher has access to all the members. Personal contact allows the interviewer to explain the study, answer queries, ask the respondent to expand on important answers and avoid misunderstanding; watching the respondent's reactions gives extra information. But it is expensive (it needs trained interviewers), takes longer, and the interviewer's presence may stop respondents from saying what they really think.
Mailed questionnaires
The questionnaire is sent by mail with a request to complete and return it by a given date. It is less expensive, can reach people in remote areas, allows no influence by an interviewer and gives respondents time for thoughtful answers. Its weaknesses: little help in clarifying instructions, so questions may be misunderstood; it cannot be used by people who cannot read; and response rates are often low because forms are returned incomplete, not returned or lost in the mail.
Telephone interviews
The investigator asks questions over the telephone. It is cheaper than personal interviews and quicker, still lets the investigator clarify questions, and suits respondents who are reluctant to answer certain questions face to face. Its main drawback is access: people without telephones are left out. Reactions cannot be watched, and there is some possibility of influencing respondents.
| Feature | Personal interview | Mailed questionnaire | Telephone interview |
|---|---|---|---|
| Cost | Most expensive | Least expensive | Relatively low |
| Response rate | Highest | Low; long response time | Relatively high |
| Clarifying questions | Yes, fully | No | Yes |
| Influence on respondent | Possible | None; anonymity kept | Relatively less, but possible |
| Reach | Needs access to members | Reaches remote areas | Only people with telephones |
| Suits | Open-ended and all types of questions | Sensitive questions; literate respondents | Quick surveys; reluctant respondents |
Worked example 1: response rate of a mailed survey
Illustrative: a researcher mails 400 questionnaires. 150 come back, of which 30 are incomplete and cannot be used. Step 1, usable returns: 150 − 30 = 120. Step 2, usable response rate: (120 ÷ 400) × 100 = 30 per cent. Step 3, non-response: 400 − 120 = 280 people, or 70 per cent, gave no usable answer. Check: 30 + 70 = 100 per cent. A low response rate like this is the typical weakness of mailed surveys, and the people who reply may differ from those who do not.
Worked example 2: choosing a mode
| Situation (illustrative) | Suitable mode | Reason |
|---|---|---|
| Collect information from a person living in a remote village with no phone network | Mailed questionnaire | The only way to reach remote areas cheaply (if the person can read) |
| Ask parents about teaching quality while the school principal is present | Avoid personal interview here; prefer mail | The principal's presence may stop parents from speaking freely |
| Quick opinion survey of 200 shopkeepers in a city in two days | Telephone interview | Cheaper and faster than visits; questions can be clarified |
| Detailed study of how farm families take loans, with many open-ended questions | Personal interview | Allows explanation, follow-up questions and observation |
The pilot survey
Before the main survey, it is advisable to try the questionnaire on a small group. This try-out is called a pilot survey or pre-testing of the questionnaire.
Where the pilot survey fits
- Draft the questionnaire Following the rules for good questions
- Pilot survey on a small group Try out the questions
- Find shortcomings Unclear questions, weak instructions, slow enumerators
- Revise; estimate cost and time Improve questions and plan resources
- Main survey Collect the data
A pilot survey (pre-test) gives a preliminary idea of the survey and checks the questions' suitability, the clarity of instructions, the performance of enumerators, and the cost and time of the actual survey.
Worked example 3: using pilot results
Illustrative: in a pilot of 20 made-up respondents, 8 misread question 5 and each interview took 25 minutes. Share misreading: (8 ÷ 20) × 100 = 40 per cent, so question 5 must be reworded. Time planning: if the main survey has 300 interviews of 25 minutes each, the time needed is 300 × 25 = 7,500 minutes = 7,500 ÷ 60 = 125 hours of interviewing. This is the kind of cost-and-time estimate a pilot makes possible.
Key takeaways: data are collected by personal interviews (highest response, costliest), mailed questionnaires (cheapest, reaches remote areas, low response) or telephone interviews (cheap and quick, limited to phone owners). The choice depends on cost, reach, the kind of questions and the respondents. A pilot survey pre-tests the questionnaire and helps estimate cost and time.
Check your understanding
-
1. Which mode of data collection has the highest response rate but is the most expensive?
- Mailed questionnaire
- Telephone interview
- Online survey
- Personal interview
Show answer
Answer: D. Personal interviews give the highest response rate because the interviewer meets the respondent, but they need trained interviewers and more time, which makes them the most expensive.
-
2. Illustrative: 500 questionnaires are mailed and 125 usable ones come back. The usable response rate is:
- 25%
- 12.5%
- 75%
- 40%
Show answer
Answer: A. Response rate = (125 ÷ 500) × 100 = 25%. The remaining 75% is the non-response.
-
3. The main disadvantage of telephone interviews according to the chapter is:
- they are costlier than personal interviews
- they take the longest time
- people who do not have telephones cannot be reached
- questions cannot be clarified
Show answer
Answer: C. Telephone interviews are cheaper and quicker and allow clarification, but people without telephones cannot be included, which limits access.
-
4. Trying out a questionnaire on a small group before the main survey is called:
- census
- pilot survey
- random sampling
- tabulation
Show answer
Answer: B. A try-out on a small group is a pilot survey or pre-test; it reveals faulty questions and helps estimate cost and time.
-
5. Assertion (A): Mailed questionnaires are suitable for sensitive questions. Reason (R): In a mail survey there is no interviewer to influence the respondent, and anonymity can be maintained.
- Both A and R are true, and R is the correct explanation of A
- Both A and R are true, but R is not the correct explanation of A
- A is true, but R is false
- A is false, but R is true
Show answer
Answer: A. Both are true, and R explains A: with no interviewer present and anonymity kept, respondents feel freer to answer sensitive questions honestly.
Sign in to keep track of the lessons you finish.