Subject Pack · S9 · Interactive
Institutional change measurement, citizen-experience metrics, before-after with structural break design, and the political economy of evaluation findings. Walk out with a governance evaluation design brief.
Walk in with a governance reform initiative. Walk out with an evaluation design brief covering institutional change measurement, citizen-experience metrics, research design, and political economy mapping.
Governance reform aims to change how institutions function -- making them more transparent, accountable, responsive, or efficient. These are inherently hard to measure because institutions are complex systems, not bounded interventions.
| Dimension | What it captures | Example indicators | Data source |
|---|---|---|---|
| Rules | Formal rule changes (laws, orders, SOPs) | New SOP adopted, RTI compliance rate, file disposal timeline | Administrative records, gazette notifications |
| Practices | How rules are actually implemented | Average service delivery time, absenteeism rates, meeting frequency | Mystery client visits, direct observation, administrative data |
| Norms | Informal expectations and culture | Corruption perception, trust in institution, perceived responsiveness | Citizen surveys, staff surveys |
| Outcomes | End results for citizens | Service access, grievance resolution, satisfaction | Citizen surveys, service delivery data |
Most governance evaluations measure rules and claim outcomes. The gap between "the SOP was changed" (rules) and "citizens experienced faster service" (outcomes) is where governance reforms succeed or fail. Measuring practices is the critical middle layer.
Rajasthan's Bhamashah Yojana digitised social protection benefit delivery. The design and figures below are hypothetical, to show the method; they are not from a published evaluation. An evaluation could measure: (a) rules -- database created, Aadhaar-linked accounts opened (output), (b) practices -- time from application to benefit receipt, number of trips to office (measured via citizen survey), (c) norms -- corruption perception around benefit delivery (pre/post survey), (d) outcomes -- inclusion errors and exclusion errors in benefit targeting. A finding of this shape would matter most, for example one where digitisation cuts the average number of citizen-office trips from, say, 4.2 to 1.8, while exclusion errors rise for households without Aadhaar.
Map the four dimensions for your reform. Answers flow into the capstone.
Governance exists to serve citizens. The most credible governance evaluation evidence comes from measuring citizen experience directly -- not from administrative self-reports or expert scorecards.
| Source | What it provides | Frequency |
|---|---|---|
| Provider absence surveys (World Bank 2003; national resurvey 2010) | Provider absenteeism, infrastructure, service quality | Two national rounds (2003, 2010) |
| Good Governance Index (DARPG) | State-level governance quality across sectors | Two editions so far (2019; 2020-21, released December 2021) |
| DISHA dashboards | District-level scheme implementation data | Real-time |
| RTI compliance data | Response rates, timelines, appeals | Annual (CIC annual report) |
| CPGRAMS | Grievance registration and disposal | Real-time |
Citizens in India often under-report negative experiences with government services, especially to unknown surveyors. They fear retaliation or believe it is futile. Use indirect questioning techniques: "Some people in this area say that obtaining a caste certificate takes 3 trips to the office and costs Rs 500 in unofficial fees. In your experience, is this more or less than what it actually takes?" This indirect framing yields more honest responses than "Did you pay a bribe?"
Design the citizen-side measurement. These flow into your capstone.