Picture this: An M&E officer attends a three-day workshop on indicator development. The facilitator is excellent. The slides are comprehensive. There's even a certificate at the end. Monday morning, she returns to her desk, opens a blank document, and realises she still can't actually construct a good indicator.
This scenario plays out thousands of times across the development sector. It's not that the workshops are bad or the learners unmotivated. It's that the approach to learning is fundamentally misaligned with how skills are actually built.
The Fluency Illusion
When we follow along with a well-presented lecture, the material feels easy to understand. We nod along, take notes, feel confident. Psychologists call this the fluency illusion—we mistake comprehension for competence. Reviewing decades of metacognition research, Bjork, Dunlosky and Kornell (2013, Annual Review of Psychology) show that the subjective sense of ease during study is a poor and often misleading guide to what we will actually be able to recall and use later.
But understanding a concept and being able to apply it are different cognitive processes. Watching someone calculate a sample size is not the same as calculating one yourself. Reading about logframe design is not the same as constructing a logframe for your specific programme using a tool like the Logframe Builder.
The evidence for closing that gap is unusually strong. In a meta-analysis of 225 studies across undergraduate science, engineering, and mathematics courses, Freeman and colleagues (2014, PNAS) found that active learning raised average exam performance by roughly half a standard deviation (about 6 percentage points), while students in traditional lecture courses were 1.5 times more likely to fail. Tellingly, some of the largest gains came from formats where learners felt they were struggling. The struggle is the learning.
The Learning Retention Pattern
You may have seen a "learning pyramid" assigning tidy retention percentages to each method — roughly 10% for reading, 90% for teaching others. Treat those numbers with caution: they are a well-documented myth. Tracing the figures to their source, Letrud and Hernes (2018, Cogent Education) show the percentages cannot be traced to any real study and were grafted onto Edgar Dale's "Cone of Experience," which itself contained no numbers at all. So we drop the fake precision and keep what the evidence actually supports: a reliable ordering. Chi and Wylie's ICAP framework (2014, Educational Psychologist) sets out that ordering on cognitive grounds — passive, then active, then constructive, then interactive engagement — and predicts learning increases as you move up it.
The idea is old. John Dewey's Experience and Education (1938) argued that genuine learning grows out of experience joined with reflection, and David Kolb's Experiential Learning (1984) formalised it as a cycle of doing, reflecting, conceptualising, and testing. More recent learning-analytics work measures the gap directly: studying tens of thousands of students, Koedinger and colleagues found that doing practice activities was associated with roughly six times the learning gain of merely reading the same material — the so-called "doer effect."
Engagement, from Passive to Interactive (ICAP)
No reliable retention percentages exist for these methods. The order — not any number — is what the research supports.
"Learning is not a spectator sport. Students do not learn much just sitting in classes listening to teachers, memorizing pre-packaged assignments, and spitting out answers."
— Chickering & Gamson, "Seven Principles for Good Practice in Undergraduate Education" (1987)
Traditional Training vs. ImpactMojo's Approach
Traditional WorkshopHow Our Labs Work
Every ImpactMojo lab follows a five-step structure designed to build transferable skills, not just temporary understanding:
- Brief Context — 2-3 minutes of reading, not 30 minutes of lecture. Just enough to understand what you're about to do and why.
- Guided Practice — A structured exercise with scaffolding. You're doing the work, but with support. This draws on Lev Vygotsky's "zone of proximal development": the gap between what a learner can do alone and what they can do with guidance, where the steepest learning happens.
- Immediate Feedback — Not just right/wrong, but explanations of why certain choices work better.
- Variations — Multiple scenarios with different contexts. Because skill means applying knowledge across situations.
- Real-World Connection — Prompts to apply what you've practiced to your actual work.
Labs You Can Try
The Transfer Problem
Even when people learn something well in a training context, they often struggle to apply it in different situations. This is the transfer problem—and it's why so much professional development fails to change practice. In their foundational review of 70 empirical studies, Baldwin and Ford (1988, Personnel Psychology) found that transfer depends heavily on how closely training conditions mirror the realities of the job — which is exactly where one-off, decontextualised workshops fall short.
ImpactMojo addresses transfer in two ways:
Designing for Transfer
- Context matters from the start — Examples drawn from real South Asian development challenges, not abstract scenarios
- Variation in practice — Multiple scenarios across different sectors, scales, and challenges so you learn the underlying principle, not just one application
Just-in-Time vs. Just-in-Case
Traditional training operates on a "just-in-case" model: learn everything now, hope you remember it when you need it. ImpactMojo enables "just-in-time" learning: encounter concepts when you need them to solve an active problem. That instinct echoes the problem-based learning model that Howard Barrows and Robyn Tamblyn pioneered in medical education (1980), where students build knowledge by working through real problems rather than absorbing it in advance.
When you're designing a survey for your programme tomorrow, the Survey Design Lab and Sample Size Lab aren't abstract—they're immediately relevant. The learning sticks because it's solving a real problem in real time.
Implications for Organisations
If you're responsible for building capacity in your organisation, these principles suggest some uncomfortable truths:
- Evaluate training by transfer, not satisfaction — Happy participants don't mean effective training
- Budget for practice, not just instruction — The workshop is the beginning, not the end
- Create opportunities for application — Mentoring, peer learning, follow-up coaching
- Embrace productive struggle — If learning feels too easy, be skeptical
"Tell me and I forget. Teach me and I remember. Involve me and I learn."
— Widely attributed to Benjamin Franklin, though the original source is disputed (cf. Xunzi)
Start Building Real Skills
ImpactMojo's labs are designed for practitioners who need to apply what they learn, not just understand it. Every exercise is built on the experiential and active-learning research described above—from Dewey and Kolb to Freeman's meta-analysis and the doer effect—and on our experience of what works in the South Asian development context. Making these resources openly available — and in multiple languages — is central to our mission.
Because the sector doesn't need more people who've attended workshops. It needs more people who can actually do the work.