| Actor | What they bring | What they often miss |
|---|---|---|
| NGO programme team | Field knowledge, relationships with communities | Costing at scale, government processes |
| Donor or CSR funder | Money, reporting templates, sometimes evidence | Local politics, seasonal and caste dynamics |
| Government department | Mandate, budget lines, frontline staff | Time to test, permission to fail |
| Researchers | Evidence, measurement, counterfactual thinking | Operations, staffing, procurement |
| Community members | Lived experience of the problem | Usually a seat at the table at all |
| Claimed cause | Evidence that would support it | Where to look |
|---|---|---|
| Girls drop out because the school is far | Enrolment falls with distance to secondary school | UDISE+ school locations, household survey |
| Mothers do not deliver in facilities because of cost | Out-of-pocket spending is high for deliveries | NFHS-5 district fact sheets |
| Farmers do not adopt a variety because of credit | Adoption rises when credit is offered | Prior trials, extension records |
| Cause | Objective | Who acts on it |
|---|---|---|
| Instruction not matched to level | Children taught at their learning level | This programme |
| Harvest-season absence | Attendance maintained through the year | Gram panchayat, school management committee |
| No books at home | Reading material in every hamlet | Library partner |
| Teacher vacancies | Posts filled | State education department (out of scope) |
| Question | Why it matters for design |
|---|---|
| Who controls the resource the programme changes? | They can redirect or block it |
| Which officials must act, and what are they rewarded for? | Unrewarded tasks are dropped first |
| Which local elites benefit from the current situation? | Expect capture or resistance |
| What happens at the next election or transfer of the collector? | Champions move; plans should not depend on one person |
| Which caste, religious or gender norms shape access? | Formal eligibility differs from actual access |
| Type of evidence | What it can tell you | Main limitation |
|---|---|---|
| Systematic review or meta-analysis | Average effect across many settings | Averages can hide where it does not work |
| Randomised evaluation | Causal effect in that setting | May not transfer to yours |
| Quasi-experimental study | Causal effect under stated assumptions | Assumptions may fail |
| Process evaluation | How and why delivery worked or broke | No estimate of impact |
| Monitoring data from a scheme | Coverage, reach, cost | No counterfactual |
| Practitioner experience | Operational detail, local fit | Selective memory |
| Finding | Design implication |
|---|---|
| Impacts on consumption and psychosocial status lasted at least a year after support ended (Science, 2015) | Time-limited support can be enough |
| Gains in Bangladesh persisted after four and seven years (QJE, 2017) | Plan follow-up measurement over years |
| The package combines asset, stipend, training, coaching and savings | Removing components needs its own test |
| Implemented by several partners in different settings | The model can be adapted, with core features kept |
| Criterion | Question to ask of each option |
|---|---|
| Evidence | Has this worked for a similar problem and group? |
| Cost per outcome | What would one unit of outcome cost? |
| Feasibility | Can our organisation and partners deliver it? |
| Scalability | Could government or others run it later? |
| Equity | Who would it reach first, and who would it miss? |
| Risk | What could go wrong, and for whom? |
| Delivery model | South Asian example | Strength | Weakness |
|---|---|---|---|
| Government frontline system | Anganwadi services, PM POSHAN school meals | Reach and permanence | Overloaded staff, slow change |
| Community institutions | Kudumbashree, JEEViKA SHG federations | Local ownership, low cost | Capture by better-off members |
| NGO direct delivery | BRAC graduation in Bangladesh | Quality control, flexibility | Hard to sustain without funding |
| Community health workers and volunteers | Nepal FCHVs, Pakistan LHWs, India's ASHAs | Trust, proximity | Workload, pay disputes |
| Private providers with public payment | PM-JAY empanelled hospitals | Capacity, choice | Fraud, cream-skimming |
| Digital | Direct benefit transfer, telemedicine | Speed, low marginal cost | Excludes the unconnected |
| Design choice | Gender question |
|---|---|
| Timing and place of activities | Can women attend without a male escort or losing wages? |
| Whose name is on the account or asset | Who controls it in practice? |
| Who is hired as frontline staff | Will women participants speak to them? |
| What the programme counts | Does monitoring capture unpaid care work? |
| Method | How it works | South Asian example |
|---|---|---|
| Categorical | Everyone in a group is eligible (age, sex, disability) | Old-age pensions, girls' stipends |
| Geographic | Everyone in selected areas | Aspirational Districts Programme |
| Proxy means test | Score from observable assets predicts consumption | BISP poverty scorecard, Pakistan |
| Deprivation criteria from a census | List built from survey indicators | PM-JAY from SECC 2011 |
| Community-based | Villagers rank or select households | Participatory wealth ranking in graduation programmes |
| Self-targeting | Benefit designed so only the needy apply | Public works paying a low wage for manual labour |
| Step | Who it tends to exclude | Design response |
|---|---|---|
| Proof of identity and address | Migrants, people without land records | Accept alternative documents |
| Bank account and mobile link | Older people, women in some households | Camp-based enrolment, assisted linking |
| Biometric authentication | Manual labourers with worn fingerprints, older people | Fallback authentication route |
| Travel to an office | People with disabilities, women with care duties | Doorstep or village-level service |
| Assumption (illustrative) | Evidence | If false | Action |
|---|---|---|---|
| Mentors visit schools fortnightly | Weak: past vacancy data | Method fades | Monitor visits monthly |
| Girls' parents allow cycling | Good: Bihar evidence | Low uptake | Check in pilot |
| Funds released by June | Mixed: past years late | Season missed | Bridge fund |
| Option (Illustrative) | Cost per child | Expected share who learn to read | Cost per additional reader |
|---|---|---|---|
| A: Level-based camps | ₹1,200 | 20 percentage points | ₹6,000 |
| B: New textbooks only | ₹400 | 2 percentage points | ₹20,000 |
| C: Teacher training only | ₹800 | 5 percentage points | ₹16,000 |
| Budget line (Illustrative) | NGO pilot cost | Government norm | Gap and plan |
|---|---|---|---|
| Mentor monthly pay | ₹25,000 | ₹18,000 | Use existing cluster staff |
| Teacher training per day | ₹900 | ₹600 | Shorter, school-based sessions |
| Reading kit per school | ₹3,500 | ₹2,000 | Simplify kit |
| Assessment per child | ₹60 | No head | Fold into school tests |
| Category | Example risk (Illustrative) |
|---|---|
| Contextual | Flood or heatwave disrupts the field season |
| Political | Transfer of a supportive district collector |
| Operational | Staff turnover above 30 per cent a year |
| Financial | Delayed release of government co-funding |
| Harm to people | Abuse of a child by staff or volunteer |
| Data | Leak of participants' caste or health data |
| Reputational | Media report of misused funds |
| Design element | Why the law makes it necessary |
|---|---|
| Written reporting procedure naming who reports to police | Reporting is a personal legal duty |
| Training for all staff and volunteers before contact with children | Everyone is covered by s19 |
| Senior officer responsible for safeguarding | Heads of institutions face higher liability under s21 |
| Vetting and code of conduct for anyone with access to children | Prevention reduces harm and liability |
| Design question | Good practice |
|---|---|
| What data do we need for delivery? | Collect only fields someone will use |
| Who can see it? | Role-based access, no shared logins |
| How is consent or notice given? | In the participant's language, read aloud where needed |
| How long is it kept? | Retention period set in the design |
| What if it leaks? | Breach procedure and named owner |
| Risk (Illustrative) | Likelihood | Impact | Response | Owner |
|---|---|---|---|---|
| Staff abuse of a child participant | Low | Severe | Vetting, two-adult rule, POCSO training, reporting procedure | Safeguarding lead |
| Government funds released late | High | Medium | Bridge fund, phased plan | Finance head |
| Elite capture of selection | Medium | High | Public reading of lists, appeal route | Programme manager |
| Data breach of participant records | Medium | High | Access controls, minimum data | Data officer |
| Extreme heat stops summer activities | High | Medium | Reschedule to mornings, shade, water | Field coordinator |
| Component | Content |
|---|---|
| Phasing | Pilot, review point, expansion in waves |
| Staffing plan | Roles, numbers, hiring dates, training |
| Procurement | What is bought, when, with what lead time |
| Calendar | Seasons, school year, financial year, elections |
| Monitoring plan | Indicators, frequency, who uses them |
| Decision points | When the team will decide to continue, adapt or stop |
| Decision | Information needed | Frequency |
|---|---|---|
| Which villages need a supervisor visit? | Attendance and session completion by village | Weekly |
| Is the dosage being delivered? | Sessions per participant against plan | Monthly |
| Are we reaching the target group? | Share of participants meeting criteria | Quarterly |
| Is the key assumption holding? | Indicator for that assumption | Monthly |
| Exit route | Design requirement |
|---|---|
| Government takes over | Use government staff, norms and budget heads from the start |
| Community institution continues | Build its finances and governance, plan reduced support |
| Time-limited by design | Show that outcomes persist after support ends |
| Market continues | Test that participants will pay at a viable price |
| Scheme feature | What it means for an NGO design |
|---|---|
| Panchayat-level plans | Support gram sabhas to put useful works in the plan |
| Normative allocation | Central funds per state are capped; districts compete for them |
| 60-day seasonal pause | Schedule complementary activities around it |
| Social audit and disclosure | Build community capacity to use the records |
| Model | Description | Example |
|---|---|---|
| Technical support | NGO advises a department on design or training | Pratham with state education departments on TaRL |
| Embedded implementation | NGO staff work inside a government programme | Support units in state livelihood missions |
| Government adopts a model | State scales an NGO-tested approach | Bihar's JEEViKA, then NRLM nationally |
| Contracted delivery | Government pays NGO to deliver a service | Outsourced services in some states |
| Joint evaluation | Government and researchers test a policy change | Large-scale trials in partnership with states |
| Cause of shrinking effects | Design response |
|---|---|
| Weaker implementer at scale | Pilot through the implementer who will scale it |
| Political opposition from affected groups | Political economy analysis, early engagement |
| Thinner supervision and lower fidelity | Plan supervision ratios and core components |
| Different population at scale | Test in typical sites |
| General equilibrium effects | Measure spillovers on non-participants |
| Step | What the team decided |
|---|---|
| Problem statement | Most Class 3-5 children in 4 blocks cannot read a Class 2 text |
| Main causes | Instruction at grade level; seasonal absence; vacancies |
| Causes in scope | Instruction; partly attendance |
| Out of scope | Vacancies (state department), noted as an assumption |
| Stakeholders | Block education officer, cluster resource persons, headteachers, SMCs, parents |
| Option (Illustrative) | Delivery | Fit with scale | Decision |
|---|---|---|---|
| A. NGO-run learning camps | Pratham-style camps run by NGO instructors | Low: parallel to school | Rejected for main design |
| B. Government teacher model | Teachers trained, cluster mentors support | High: uses department staff | Chosen |
| C. Books and libraries only | Supply reading material | Medium | Kept as add-on |
| Indicator | Decision rule at end of year one (Illustrative) |
|---|---|
| Sessions held as scheduled | Below 60%: redesign timetable with headteachers |
| Mentor visits per school per month | Below 1: renegotiate mentor time with district |
| Children moving up a level per term | Below 15%: review teaching practice before expansion |
| Cost per child against budget | Over 20% above: simplify materials or training |
| Question | What a weak answer looks like |
|---|---|
| What problem, for whom, and how do you know? | General statements with no data or dates |
| Why this intervention over others? | No alternatives considered |
| What evidence supports it, and in what setting? | Evidence from a different mechanism |
| Who exactly will receive it, and who might be missed? | 'All poor households' |
| What is the cost per outcome? | Only cost per output or per participant |
| What are the riskiest assumptions? | None listed, or all rated low |
| Who will run this after the grant? | 'The community will take over' |
| Failure | What it looks like | Prevention |
|---|---|---|
| Solution first | Programme designed around a favoured intervention | Problem analysis before options |
| Wrong cause | Acting on a cause that is not binding here | Check causes against data |
| Ignored incentives | Officials or staff quietly undermine it | Political economy analysis |
| Thin dosage | Budget spread too widely to work | Reach fewer people properly |
| Pilot-only conditions | Works with founders, fails at scale | Pilot with the scaling implementer |
| Exclusion by design | Paperwork or channels shut out the poorest | Map steps to receipt |
| No learning loop | Problems found at the final evaluation | Decision rules and monitoring |