Subject Pack · S7 · Interactive
Policy evaluation vs programme evaluation, political economy awareness in design, implementation tracking and regulatory impact, and welfare-effect estimation approaches. Walk out with a policy evaluation design brief.
Walk in with a public policy or government scheme. Walk out with an evaluation design brief covering the policy-programme distinction, political economy mapping, implementation tracking, and welfare estimation approach.
A programme is a bounded intervention with defined beneficiaries, a budget, and a start/end date. A policy is a rule, incentive structure, or institutional arrangement that shapes behaviour across an entire population. Evaluating the two requires different logics.
| Dimension | Programme evaluation | Policy evaluation |
|---|---|---|
| Scope | Bounded: specific geographies, beneficiaries | Universal or near-universal: affects entire populations |
| Counterfactual | Non-participants or comparison group | Often no untreated group (universal policies); use pre-post, cross-state, or regression discontinuity |
| Implementation | Controlled by implementing agency | Mediated through bureaucracy, politics, and state capacity |
| Timeline | 2-5 years typical | Effects unfold over decades; political cycles interrupt |
| Data | Primary collection usually feasible | Often relies on administrative data (NSSO, PLFS, Census, SECC) |
India has a growing culture of policy evaluation but it remains patchy. NITI Aayog's Development Monitoring and Evaluation Office (DMEO) commissions evaluations of centrally sponsored schemes. DMEO was formed in September 2015 by merging the Programme Evaluation Organisation (PEO) and the Independent Evaluation Office (IEO). State-level evaluation capacity varies widely. Some states have their own bodies, such as the Karnataka Evaluation Authority (set up in 2011); many have little capacity.
PM-KISAN (Rs 6,000/year cash transfer to farmer families) was implemented nationally in February 2019. No randomisation was possible because it is a universal entitlement. Designs open to an evaluator include: (a) pre/post comparisons using household survey data, (b) regression discontinuity at the 2-hectare cutoff (in the initial design which had a landholding cap), and (c) difference-in-differences across states with faster vs slower DBT rollout. Each design answers a different question and has different limitations.
Fill these for your policy/scheme. Answers flow into the capstone.
Policy evaluation is never politically neutral. The findings will be used, misused, or ignored depending on who commissioned the evaluation, when in the political cycle it is released, and which stakeholders benefit from the current policy.
Department of Expenditure rules require a third-party evaluation before a central scheme is continued into a new Finance Commission cycle (OM of 5 August 2016, restated in the OM of 31 October 2025). The evaluator often depends on the same ministry for future work, which creates an incentive towards favourable findings. Document your quality assurance process explicitly: peer review by named experts, pre-registered analysis plan, data deposited in a public repository.
Map the political economy. These flow into your capstone.