Subject Pack · S4 · Interactive
What "learning outcomes" actually means in the Indian context, how teacher practice connects to student outcomes, NEP 2020 evaluation opportunities, and the TaRL evidence pattern. Walk out with an education evaluation design brief.
Walk in with an education programme. Walk out with an evaluation design brief -- learning outcome measurement, teacher-practice linkage, data plan, and analysis approach. Built automatically from your module answers.
India has at least four different systems for measuring learning outcomes, and they do not agree with each other. Before designing an education evaluation, you must decide which definition of "learning" you are measuring, and why.
| System | What it measures | Grades | Strengths | Limitations |
|---|---|---|---|---|
| ASER | Foundational literacy and numeracy (can the child read a paragraph? do division?) | Ages 5-16 (household-based) | Simple, comparable across states/years, household-based avoids school-selection bias | Floor-level measure; cannot differentiate above-basic proficiency |
| NAS | Curriculum-linked competencies across subjects | 3, 5, 8, 10 | Government-administered, nationally representative, aligned to NCF | School-based (misses out-of-school children), item quality varies |
| Board exams | Subject mastery at secondary/higher secondary | 10, 12 | High-stakes, institutionally embedded | Rote-focused, not comparable across boards |
| PISA | Application of knowledge in reading, math, science | 15-year-olds | International comparability | India has taken part only once, in the PISA 2009+ round (Himachal Pradesh and Tamil Nadu) |
Pratham's Read India uses ASER-type assessments because their programme explicitly targets foundational literacy. The assessment takes a few minutes per child, is administered one-on-one, and produces a clear categorical outcome (cannot read, letter level, word level, paragraph level, story level). This simplicity is a feature, not a limitation -- it matches the programme's theory of change precisely.
Fill these for your programme. Your answers flow into the capstone.
Most education programmes in India work through teachers -- training them, providing materials, or restructuring classrooms. The evaluation question is whether changes in teacher practice lead to changes in student learning. This link is harder to establish than it appears.
Teacher training programmes routinely measure: (a) training attendance, (b) teacher knowledge post-training, and (c) teacher satisfaction. None of these predict classroom behaviour change. The critical measure is what teachers actually do differently in the classroom after the training.
| Protocol | What it captures | India use | Cost per observation (illustrative) |
|---|---|---|---|
| Stallings Snapshot | Time-on-task, activity type (10 snapshots at even intervals across a lesson, each a 15-second scan) | Used in many World Bank studies; suits large samples | Rs 3,000-4,000 |
| CLASS | Emotional support, classroom organisation, instructional support | Developed and validated mainly in US classrooms; needs extensive observer training | Rs 5,000-7,000 |
| Teach (World Bank) | Time on learning plus 9 elements of teaching practice in 3 areas | Growing use; free World Bank tool | Rs 3,500-5,000 |
| Custom structured checklist | Programme-specific behaviours (e.g., "uses TLM," "groups students by level") | Most common in Indian NGO evaluations | Rs 2,000-3,000 |
Teacher training changes teacher knowledge (maybe). Teacher knowledge changes teacher practice (sometimes). Teacher practice changes student learning (under specific conditions). Each link requires separate evidence. Most evaluations measure the first link and claim the third.
Teachers teach differently when observed. A single announced observation captures performance behaviour, not typical practice. Budget for at least two observations per teacher, one unannounced. Fixed-interval coding such as the Stallings snapshot reduces subjective judgement, though it does not remove the observer effect.
Design how you will measure teacher practice change. These flow into your capstone.