Subject Pack · S1 · Interactive

SEL Evaluation: Design & Instruments

A 3-hour interactive Practice Pack. Fill the forms as you go: your inputs save in your browser. By the end, click Build my brief and the capstone artefact builds itself.

4 modules~3 hoursInteractiveIndia · India-context

Your progress
0% complete
Your Capstone

One-page SEL Evaluation Design Brief

Walk in with an SEL programme. Walk out with a defensible design: research question, sample frame, selected instruments with justification, data collection plan + budget sketch, mixed-methods integration approach, reporting outline. Built automatically from your module answers.

Module 1 · ~25 min

What kind of evaluation do you actually need?

The number-one reason SEL evaluations disappoint is that the design choice happens implicitly. The team picks the method they've used before. The funder asks for "impact." Someone says "mixed-methods" without specifying what is mixed with what. Six months later, the data answers a question nobody quite asked.

Before any instrument selection, walk through three dimensions explicitly.

Dimension 1: What is the question, really?

Dimension 2: What evidence will be persuasive?

Dimension 3: Snapshot or change?

Worked example (fictional organisation, hypothetical figures)

Illustrative case: Manobal Learning Trust, a fictional NGO, runs SEL in 40 Mumbai government schools, three years in. Funder wants evidence for renewal. Budget ₹15L, 9 months.

D1: Outcome primary, process secondary. D2: Mixed-methods (quant primary). D3: Quasi-experimental matched comparison. Honest about the limit (no clean baseline).

Your Design Decision Sheet

Fill these for your programme. Your answers save automatically and flow into the final capstone.

e.g., "Manobal Learning Trust (fictional) SEL: 40 Mumbai govt schools, grades 4-6, 3 years running"
"We will use the findings to ____": be specific. With a date.
Honest sentence about the limits.
Saved
Self-check
A client wants to know "why" their SEL programme helped some children more than others. What design type fits?
Outcome evaluation with RCT
Process tracing or theory-based evaluation
Cross-sectional survey
Retrospective design
Correct. "Why" and "for whom" are mechanism questions: process tracing or theory-based evaluation gives you the causal narrative. An outcome evaluation tells you whether it worked, not why.
Module 2 · ~30 min

Choosing your measurement approach

Three persistent SEL-instrument failure modes:

  1. Imported instruments used without cultural adaptation: Indian children interpret items differently than US/UK populations.
  2. Programme-developed instruments that measure exposure to the programme rather than the underlying competency.
  3. Self-report scales used as sole measure with younger children, where social-desirability bias dominates.

Available instruments by framework

FrameworkSample instrumentsIndia status
CASELSECA, DESSA, SSIS-SELTranslated; limited India validation; item-level concerns
SEE LearningEmbedded reflection rubrics; Emory University SEE Learning materialsUsed in Indian pilot schools; not yet rigorously validated
WHO Life Skills / NCERT AEPNCERT AEP self-rating; SCERT well-being modulesMost aligned with government schools. Check validation evidence for each before use
Direct assessmentHead-Toes-Knees-Shoulders; Dimensional Change Card SortBypasses self-report bias; narrower constructs
Behavioural observationCLASS; structured peer-interaction logsHighest validity, highest cost; needs trained observers
Adult reportTeacher rating scales; parent SDQ IndiaOperationally easy; rater-bias concerns

How to choose

Adaptation, not translation

Indian cultural validation ≠ translation. Translation handles language; adaptation handles whether "self-regulation" means the same thing in a Mumbai government school as in a Boston suburb. Budget at least one cognitive-pretesting round per instrument.

Your Instrument Selection Matrix

Pick a primary quant instrument + secondary triangulation source. These flow into your capstone.

e.g., "Grades 4-6, Mumbai government schools, Hindi/Marathi/English code-switching"
Name + framework: e.g., "Teacher-rated life skills scale (WHO Life Skills aligned)"
e.g., "30 child interviews + 20 teacher interviews"
What does it under-measure? What bias does it carry?
Saved
Self-check
You're evaluating an SEL programme in Grade 3 government schools. Which instrument is LEAST appropriate as your primary measure?
Behavioural observation (CLASS)
Teacher rating scale
Self-report CASEL competency scale (translated, not adapted)
Direct assessment (Head-Toes-Knees-Shoulders)
Correct. Two compounding problems: Grade 3 children's self-report is dominated by social-desirability bias, and an unadapted CASEL scale has India-validity concerns. Behavioural observation or direct assessment is methodologically stronger for this age.