- Practice
- About 15 min
- 5 practice questions
Measuring service delivery: indicators, feedback and social audit
Choose good indicators for charter standards, use citizen feedback tools such as report cards and social audit, and avoid gaming of targets.
If something looks wrong, please tell us.
A charter's standards mean little unless someone measures whether they are met. But measurement can also mislead or be gamed. This lesson covers how to choose indicators, how to collect citizens' views, and how to keep the numbers honest.
Good indicators
| Indicator | What it shows | Possible distortion |
|---|---|---|
| Percentage of applications decided within the standard time | Timeliness | Rejecting files to stay within time |
| Average and longest waiting time | Typical and worst experience | Averages hide very long waits for a few |
| Share of applications rejected, with reasons | Fairness of decisions | Vague reasons to justify rejections |
| Complaints per thousand services, and time to resolve | Quality and responsiveness | Discouraging people from complaining |
| Repeat visits needed per service | Ease of access | Not recording visits |
| Citizen satisfaction from independent surveys | Experience as citizens see it | Surveys run by the office itself |
Use a small set of indicators together, so that gaming one shows up in another. For example, if timeliness rises while rejections also rise sharply, officers may be rejecting files to beat the clock.
Citizen feedback tools
- Citizen report cards: surveys of users rating public services on access, quality and corruption, pioneered in Bengaluru in the 1990s by the Public Affairs Centre and later used widely.
- Community score cards: users and providers meet to score a service together and agree on improvements.
- Social audit: the community examines records of a programme in public, for example the social audits of rural employment works by the gram sabha under the national rural employment guarantee law.
- Exit feedback: a short rating when a service is completed, by SMS or at the counter.
- Mystery shopping: independent testers use the service as ordinary citizens and report their experience.
Worked example 1: reading the data
A licensing office reports that 95 per cent of applications are decided within the standard 10 days, up from 70 per cent. But rejections have risen from 5 to 25 per cent, and repeat applications have doubled. Interpretation: the timeliness gain is probably partly false, achieved by rejecting files that would have taken longer. Action: require written reasons for every rejection, sample rejected files for review, and add 'first-time approval rate' as an indicator.
Worked example 2: social audit of a works programme
In a village, the muster rolls for a road project are read out at a public meeting. Several names belong to people who say they never worked, and the road is shorter than the measurement book records. The social audit has done what internal monitoring did not: it compared official records with lived reality. The follow-up must include recovery of wrongly paid amounts, action against those responsible, and protection for villagers who spoke up.
A final caution: what gets measured gets managed, and what is not measured can be neglected. If an office is judged only on speed, courtesy and fairness may suffer. Including at least one indicator of citizens' own experience keeps attention on what the charter is for.
Measure a few things together, ask citizens directly, check records in public, and watch for numbers that improve too neatly.
Key takeaways
- Choose a balanced set of indicators so gaming in one shows up in another.
- Citizen report cards, score cards, social audit and mystery shopping capture the citizen's view.
- Social audit compares official records with what people actually experienced.
Check your understanding
-
1. Timeliness rises from 70 to 95 per cent while rejections rise from 5 to 25 per cent. What is the most likely explanation?
- Citizens are applying more carefully and submitting better files
- Officers may be rejecting files to stay within the time standard
- The standard is too generous, so officers meet it with ease
- Nothing to worry about; the office has improved in speed and quality
Show answer
Answer: B. A sharp rise in rejections alongside timeliness gains suggests gaming. Reasons for rejection and file sampling can test this.
-
2. Citizen report cards on public services in India were pioneered in the 1990s in:
- Hyderabad
- Bengaluru
- Ahmedabad
- Chandigarh
Show answer
Answer: B. The Public Affairs Centre in Bengaluru pioneered citizen report cards in the 1990s.
-
3. Which tool involves the community examining a programme's records, such as muster rolls, in a public meeting?
- Mystery shopping
- Exit feedback
- Social audit
- Average waiting time
Show answer
Answer: C. A social audit lets the community check official records against their own knowledge in public.
-
4. Why should a satisfaction survey ideally be independent?
- Because surveys run by the office itself may be biased towards favourable results
- Because citizens are unable to answer questions about the service they receive
- Because independent surveys are always free of cost to the department concerned
- Because offices are not allowed by law to ask citizens anything about their service
Show answer
Answer: A. Self-run surveys risk selection and pressure biases. Independence improves credibility.
-
5. Which indicator would best reveal that citizens must visit an office many times for one service?
- Total revenue collected per year
- Number of staff posted in the office
- Average file thickness in pages
- Repeat visits needed per service
Show answer
Answer: D. Counting visits per service directly measures the burden that repeated visits place on citizens.
Sign in to keep track of the lessons you finish.