The Courage to Follow the Evidence
In development work, pivoting is hard. Organisations invest years building programmes, training staff, developing materials, and cultivating donor relationships around a particular theory of change. When monitoring data suggests the theory is wrong — or that a different approach would be more effective — the institutional pressure to ignore the evidence can be overwhelming. Yet the organisations that have the courage to follow the data, even when it is uncomfortable, often achieve the most transformative outcomes.
These three stories from Indian development illustrate what happens when M&E systems work as they should — not just tracking outputs for donor reports, but generating actionable insights that reshape programme strategy. The gap between producing data and actually using it is well documented: MEASURE Evaluation's data demand and use framework makes the point bluntly — building information systems that capture quality data is only half the task; decision-makers also have to want to use the data and be equipped to act on it. Each story below relies on strong data quality as the foundation. Each is drawn from published research and documented organisational trajectories. Each involves a moment of reckoning, when leaders confronted evidence that challenged their assumptions and chose to act on it rather than explain it away.
Story One: India's ICDS — The Nutrition System That Fed Households Instead of Children
India's Integrated Child Development Services (ICDS) is the world's largest early childhood programme — reaching over 80 million beneficiaries through a network of 1.4 million Anganwadi centres. For decades, the programme's Supplementary Nutrition Programme (SNP) consumed roughly half of all ICDS expenditure. Output numbers were staggering: millions of meals served, millions of take-home ration packets distributed, hundreds of thousands of health workers deployed. By every activity metric, ICDS was succeeding at enormous scale. This is exactly the trap anthropologist Marilyn Strathern distilled into the popular phrasing of Goodhart's law: "when a measure becomes a target, it ceases to be a good measure." Meals served and packets distributed had become the targets — and the system optimised for them rather than for the nutritional outcome they were supposed to proxy.
Then came the outcome data. A landmark World Bank assessment — Gragnolati, Shekar, Das Gupta, Bredenkamp & Lee (2005), India's Undernourished Children: A Call for Reform and Action — documented what field workers had long suspected but the system had not confronted. Child malnutrition rates in ICDS areas had barely shifted. Anaemia among pregnant women remained stubbornly high. The programme was distributing food, but children were not becoming less malnourished.
The deeper analysis was revealing. Take-home rations were being shared across entire households — a rational response by families where everyone was hungry, but one that diluted the nutritional impact on the target child or pregnant mother. Nutrition counselling was delivered in group settings where women felt unable to ask about sensitive topics. And Anganwadi workers — overburdened with responsibilities across multiple government schemes — were spending an average of just minutes per household on nutrition counselling. As the World Bank report put it: ICDS had given "more attention to increasing coverage than to improving the quality of service delivery."
The evidence catalysed a generation of reforms. The Alive & Thrive initiative (supported by the Gates Foundation and managed by FHI 360) worked with the UP State Nutrition Mission to shift from group-based counselling to interpersonal home visits and individual take-home rations. IDinsight's evaluation of the Take-Home Ration programme tested redesigned delivery models. POSHAN Abhiyaan (launched 2018, supported by the World Bank across 11 states) built on these findings to restructure last-mile delivery — introducing mobile-based monitoring, reducing worker caseloads, and measuring outcomes rather than outputs. The data had been painful, but it pointed the way to a nutrition system that could actually work.
Sources: Gragnolati et al. (2005), India's Undernourished Children: A Call for Reform and Action, World Bank; Alive & Thrive India programme documentation, FHI 360; IDinsight (2019), Improving the Implementation of the Take Home Ration Programme Under ICDS; World Bank (2021), POSHAN Abhiyaan evaluation surveys.
"More attention has been given to increasing the coverage than to improving the quality of service delivery and to distributing food rather than changing family-based feeding and caring behavior, which has resulted in limited impact." — Gragnolati et al., World Bank (2005)
Story Two: JEEViKA Bihar — The Livelihoods Programme That Found Its Real Impact Was Not Income
JEEViKA — the Bihar Rural Livelihoods Project, one of India's largest NRLM implementations — was designed around a clear theory of change: mobilise poor women into Self-Help Groups (SHGs), link them to bank credit, build their financial capabilities, and household income will rise. By the early 2010s, JEEViKA had mobilised millions of women across Bihar's most disadvantaged districts. The programme tracked the expected indicators — savings accumulated, loans disbursed, enterprises started, monthly income from SHG-linked activities.
The income data was modest. A rigorous evaluation by Datta (2015), published in World Development, found that while JEEViKA produced "substantial increases in the overall per capita consumption in treatment areas," the researchers "could not detect an increase in the levels of income or assets." The programme seemed to be smoothing consumption — helping households manage money better — rather than generating transformative new income. Some observers began questioning whether the massive investment was justified.
But the same evaluation revealed something the income indicators had missed entirely. JEEViKA produced "significant and robust results on the empowerment levels of beneficiary women." Women in programme areas reported dramatic shifts in household decision-making power, physical mobility, and participation in public meetings — including gram sabha attendance. The early intensive phase of JEEViKA's rollout was "associated with significant shifts in gender norms around decision-making, mobility and participation in public meetings." The programme's real impact was not primarily economic — it was social and political. The SHG meetings had become spaces where women developed collective agency, voice, and public presence.
The pivot was consequential. Rather than abandoning the SHG model because income effects were modest, Bihar's programme leadership and the World Bank team reframed the theory of change. Subsequent phases deliberately strengthened the social capital and women's empowerment dimensions — adding rights awareness, community mobilisation for entitlements, and collective-action components to the SHG curriculum. The M&E framework was redesigned to capture empowerment outcomes alongside economic ones. JEEViKA's scaling strategy — and its case to funders — was transformed by following the evidence to where it actually led. Today JEEViKA reaches over 10 million women and is one of the most studied livelihoods programmes in the global South.
Sources: Datta, U. (2015), "Socio-Economic Impacts of JEEViKA: A Large-Scale Self-Help Group Project in Bihar, India," World Development, Vol. 68, pp. 1–18; Hoffmann, V., Rao, V., Surendra, V. & Datta, U. (2021), "Relief from Usury: Impact of a Self-Help Group Lending Program in Rural India," Journal of Development Economics; World Bank JEEViKA cost-benefit analysis (2020).
Story Three: Pratham — The Education Organisation That Chose Depth Over Breadth
Pratham is India's largest education NGO — and one of the few that has publicly, rigorously, and repeatedly documented its own scaling failures. Through the 2000s, Pratham's Read India programme reached millions of children across multiple states with supplementary learning support delivered through government school partnerships. The organisation's dashboard showed impressive and growing reach. Donors were enthusiastic.
Then Pratham did something unusual: it evaluated itself honestly. Using data from ASER (the Annual Status of Education Report, which Pratham itself created), and through a series of randomised evaluations conducted with J-PAL researchers — documented in Banerjee, Banerji, Berry, Duflo et al. (2017), "From Proof of Concept to Scalable Policies," published in the Journal of Economic Perspectives — the organisation confronted a troubling pattern. When Pratham's own trained volunteers delivered the programme, learning gains were substantial. When the same programme was delivered through government teachers at scale, with less intensive training and oversight, the learning gains largely disappeared. Scale had come at the cost of the implementation quality that made the programme work — the diluted version kept the form of Read India while shedding the function that made it effective. Lant Pritchett, Michael Woolcock and Matt Andrews call this failure mode isomorphic mimicry: institutions that look like a functioning programme on paper while quietly losing the capability that delivered results.
Pratham's leadership faced the hardest question in development: do you keep the big numbers, or do you keep the impact? They chose impact. Rather than continuing to scale a diluted version of Read India, they pivoted to a fundamentally different model — Teaching at the Right Level (TaRL). TaRL concentrated instruction into short, intensive "learning camps" (typically 30–60 days), grouped children by actual learning level rather than grade, and used a simpler, more fidelity-robust design that could survive the transition from NGO volunteers to government teachers. The model was smaller per round but dramatically more effective per child.
The results vindicated the pivot. Multiple cluster RCTs (Banerjee et al. 2007, 2017) documented effect sizes of 0.2–0.7 standard deviations on basic literacy and numeracy — large by any education-research standard. Bihar's state government adopted TaRL as Mission Gunvatta, reaching tens of millions of children. Pratham's willingness to sacrifice reach for quality, document the sacrifice publicly, and rebuild around a more defensible model is now studied at Harvard Kennedy School as a case in how development organisations learn while scaling.
Sources: Banerjee, A., Banerji, R., Berry, J., Duflo, E. et al. (2017), "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, Vol. 31(4), pp. 73–102; Banerjee, A. et al. (2007), "Remedying Education: Evidence from Two Randomized Experiments in India," Quarterly Journal of Economics; "How Pratham Learns While Scaling," Harvard Kennedy School Faculty Working Paper No. 438; ASER Centre annual reports, 2005–2024.
What These Stories Teach Us
These three pivots share common features. Each required an M&E system capable of generating uncomfortable truths — underpinned by strong indicators that actually matter. As the World Bank's chief statistician Haishan Fu puts it, "you can't course-correct what you can't see" — and seeing clearly meant building data systems that surfaced outcomes, not just outputs. Each required leaders willing to act on evidence even when it contradicted institutional narratives, drawing on the kind of learning culture that makes honest inquiry possible. And each ultimately strengthened the organisation — not despite the pivot but because of it.
Critically, all three are now in the public record because the organisations and researchers involved chose to publish the findings — including the failures. ICDS's problems are documented in a World Bank report. JEEViKA's modest income effects are in a peer-reviewed journal. Pratham's scaling failures are in the Journal of Economic Perspectives. The development sector needs more of this: not just success stories, but honest accounts of what the data showed and what was done about it.