MEL 101 - Workshop 1: Foundations of Monitoring, Evaluation & Learning

75-90 Minutes

Workshop 1: MEL frameworks & theory of change development

Target Audience: Development practitioners, program managers, NGO staff, researchers, and policy analysts working on social development programs

Prerequisites: Basic understanding of development programs and project management

Materials Needed: Sticky notes, flip chart paper, markers, sample program documents

Learning objectives

By the end of this workshop, participants will be able to:

Distinguish between monitoring, evaluation, and learning and explain their interconnections
Develop a comprehensive Theory of Change for a development program
Design results chains that link inputs to long-term outcomes
Select appropriate indicators for different levels of the results framework
Plan basic data collection strategies for MEL systems

Part 1: What is MEL and why does it matter?

20 minutes

Opening scenario: Two NGOs, different approaches

NGO A: Implements a girls' education program for 3 years, collects attendance data monthly, conducts final evaluation, reports 85% attendance rate as "success."

NGO B: Implements similar program, tracks attendance plus learning outcomes, family attitudes, teacher capacity. Uses data quarterly to adjust program design. Discovers attendance is high but learning is low, and pivots to a focus on teacher training.

Question: Which approach is more likely to create lasting change? Why?

Understanding MEL: Three interconnected functions

Monitoring

Purpose: Track progress and performance

Ongoing data collection
Performance against targets
Early warning systems
Accountability to stakeholders

Example: Monthly tracking of girls enrolled, attendance rates, dropout reasons

Evaluation

Purpose: Assess effectiveness and impact

Systematic assessment
Causal attribution
Value for money analysis
Evidence for scaling

Example: Comparing learning outcomes of program girls vs. control group

Learning

Purpose: Generate insights for improvement

Reflection and adaptation
Knowledge management
Continuous improvement
Innovation and iteration

Example: Understanding why some girls succeed despite barriers, scaling effective approaches

Why MEL matters: The evidence-to-impact pipeline

Strong MEL systems don't just measure, they drive better outcomes by:

Improving program design through real-time feedback
Increasing accountability to beneficiaries and funders
Building evidence for policy and practice change
Supporting scaling of effective interventions
Contributing to sector knowledge and innovation

Part 2: Theory of change - your program's story of change

25 minutes

What is a theory of change?

Definition: A comprehensive description and illustration of how and why a desired change is expected to happen in a particular context.

Key Components:

Long-term outcomes: The ultimate change you want to see
Preconditions: What must happen for change to occur
Assumptions: Beliefs about how change happens
Activities: What you will do to catalyze change
Context: External factors that influence change

Building a theory of change: Step-by-step process

Impact

Long-term sustainable change

Reduced gender inequality in education

Outcomes

Medium-term changes in behavior/conditions

Girls complete secondary education

Outputs

Direct products of activities

Girls enrolled in school, teachers trained

Activities

What you do

Scholarship program, teacher training

Inputs

Resources invested

Staff, funding, materials

Theory of change workshop (15 minutes)

Scenario: Design a Theory of Change for improving maternal health in rural areas.

Context:

High maternal mortality in remote villages
Limited access to skilled birth attendants
Cultural barriers to facility-based delivery
Poor transport infrastructure

Your Task (work in pairs):

Start with Impact: What's the ultimate change you want? (3 minutes)
Work backwards to Outcomes: What changes need to happen first? (4 minutes)
Identify Outputs: What products/services will create these changes? (3 minutes)
Design Activities: What will you actually do? (3 minutes)
List key Assumptions: What must be true for this to work? (2 minutes)

Reflection: What are the critical assumptions that could break your theory?

Strong theory of change characteristics

Plausible: Links between levels make logical sense
Feasible: Achievable given context and resources
Testable: Assumptions can be verified through evidence
Specific: Clear about who, what, where, when
Evidence-based: Grounded in research and experience

Part 3: Indicators - making change measurable

20 minutes

Types of indicators

Indicator Type	Purpose	Example (Girls' Education)	Data Source
Input Indicators	Resources invested	Number of teachers trained	Training records
Output Indicators	Products/services delivered	Number of girls enrolled	School registration
Outcome Indicators	Changes in people's lives	Girls' learning achievement levels	Test scores, assessments
Impact Indicators	Long-term change	Gender parity in employment	Labor force surveys

SMART indicators framework

Making indicators SMART

S - Specific

Clear about what is being measured

Poor: "Improved health"

Good: "Reduced under-5 mortality rate"

M - Measurable

Quantifiable with clear units

Poor: "Better nutrition"

Good: "Percentage of children with normal weight-for-height"

A - Achievable

Realistic given context and resources

Consider: Baseline levels, timeframe, external factors

R - Relevant

Directly related to objectives

Test: Does this indicator tell us if we're achieving our goal?

T - Time-bound

Clear timeframe and target

Example: "80% by December 2027"

Indicator development practice (8 minutes)

Challenge: Develop SMART indicators for this outcome: "Improved financial inclusion among women entrepreneurs"

Your Task:

Write 3 different indicators that could measure this outcome
Choose the best one and make it SMART
Identify potential data sources
Consider what might make this indicator misleading

Indicator	SMART Elements	Data Source	Potential Issues
Your indicator:	S:___ M:___ A:___ R:___ T:___

Common indicator pitfalls

Indicator fixation: Measuring what's easy rather than what matters
Too many indicators: Data burden overwhelms learning
Attribution confusion: Measuring changes you can't influence
Gaming: Perverse incentives that distort behavior
Static indicators: Not adapting as programs evolve

Part 4: Data collection strategies

15 minutes

Choosing data collection methods

Quantitative methods

Surveys: Baseline, midline, endline studies
Administrative data: School records, health registers
Service statistics: Program participation data
Observation: Structured checklists, audits

Strengths: Standardized, comparable, good for trends

Limitations: May miss detail, context and explanations

Qualitative methods

Interviews: Key informants, beneficiaries
Focus groups: Community discussions
Observation: Ethnographic, participatory
Case studies: In-depth program stories

Strengths: Depth of detail, explanations, unexpected insights

Limitations: Not generalizable, resource-intensive

Participatory methods

Community mapping: Local problem identification
Most Significant Change: Story collection
Outcome harvesting: Verifying changes
Social accountability: Citizen feedback

Strengths: Ownership, local knowledge, empowerment

Limitations: May lack rigor, time-consuming

Digital/tech-enabled

Mobile surveys: KoBo, SurveyCTO
SMS polling: Real-time feedback
Digital diaries: Self-reporting tools
Sensor data: Automated monitoring

Strengths: Real-time, cost-effective, reduces errors

Limitations: Digital divide, technical skills needed

Data collection best practices

Mix methods: Triangulate for fuller picture
Start simple: Build systems gradually
Use existing data: Don't collect what already exists
Build capacity: Train staff on data quality
Close the loop: Share findings with data providers
Consider burden: Balance learning needs with respondent time

Part 5: MEL system design principles

10 minutes

Building effective MEL systems

1. Fit for Purpose

Aligned with program objectives and stakeholder needs
Appropriate complexity for organization capacity
Responsive to decision-making requirements

2. Participatory and Inclusive

Involves beneficiaries in design and implementation
Multiple stakeholder perspectives included
Accessible to different literacy and technology levels

3. Learning-Oriented

Regular reflection and adaptation cycles
Safe spaces for discussing failures and challenges
Knowledge management and institutional memory

4. Cost-Effective

Proportionate investment, sized to the decisions the evidence has to support
Use existing data sources where possible
Focus on critical questions rather than comprehensive measurement

5. Ethical and "Do No Harm"

Respect beneficiary privacy and consent
Consider potential negative consequences of data collection
Ensure data security and appropriate use

MEL as a management tool

Remember: MEL is not an add-on to programs, it's an integral management function that:

Informs strategic planning and adaptive management
Enables evidence-based decision making
Strengthens accountability to all stakeholders
Contributes to sector learning and innovation
Demonstrates impact for sustainability and scaling

Essential MEL resources

Foundational Reading:

"Outcome Mapping: Building Learning and Reflection into Development Programs" by Sarah Earl, Fred Carden and Terry Smutylo
"Better Evaluation" website - comprehensive evaluation resources
"Developmental Evaluation" by Michael Quinn Patton
"Purposeful Program Theory" by Sue Funnell and Patricia Rogers

Indian Development Context:

Evaluation reports and guidance from the Development Monitoring and Evaluation Office (DMEO), NITI Aayog
"Norms and Standards for Evaluation" by the United Nations Evaluation Group (2016)
Development Evidence Portal by 3ie (International Initiative for Impact Evaluation)

Practical Tools and Platforms:

KoBo Toolbox: Free mobile data collection platform
DHIS2: Open source health information system
SurveyCTO: Mobile data collection and analysis
Power BI/Tableau: Data visualization tools

Professional Networks:

Evaluation Community of India (ECOI): Professional network
American Evaluation Association (AEA): Global resources
International Development Evaluation Association (IDEAS): Development focus
3ie: Evidence for development impact

Data Sources for Context:

National Sample Survey (NSS): Household surveys
National Family Health Survey (NFHS): Health and nutrition
Unified District Information System for Education Plus (UDISE+): Education data
Census and Socio-Economic and Caste Census (SECC): Demographics

Next Steps in ImpactMojo:

MEL 102: Advanced evaluation methods and adaptive management
Econometrics 101: Statistical methods for impact evaluation
Qualitative Research 101: In-depth data collection methods
Data Literacy 101: Data analysis and visualization skills

This handout is part of the ImpactMojo 101 Knowledge Series
Licensed under CC BY-NC-ND 4.0 • Free to use with attribution • www.impactmojo.in

For complete Theory of Change templates, indicator libraries, and MEL planning tools, visit the ImpactMojo platform.