Subject Pack · S6 · Interactive

Climate Adaptation Programme Evaluation

Adaptation vs mitigation evaluation, vulnerability measurement under deep uncertainty, longitudinal cohort design for slow-onset change, and attribution in a changing baseline. Walk out with a climate adaptation evaluation design brief.

4 modules~3 hoursInteractiveIndia-context

Your progress
0% complete
Your Capstone

Climate Adaptation Evaluation Design Brief

Walk in with a climate adaptation programme. Walk out with an evaluation design brief covering evaluability framing, vulnerability measurement, longitudinal design, and attribution strategy.

Module 1 . ~25 min

Adaptation vs mitigation -- what can be evaluated

Mitigation evaluation is relatively straightforward: did CO2 emissions decrease? Adaptation evaluation is harder because adaptation success means "bad things did not happen" -- it is measuring a counterfactual absence. A farmer who diversifies crops because of a climate-resilience programme and then survives a drought is a success. But without the drought, the adaptation looks like wasted effort. And you cannot schedule a drought for your endline.

What makes adaptation evaluation different

Evaluable adaptation outcomes in India

Outcome typeExampleTimeframeMeasurability
Adoption of climate-smart practicesCrop diversification, drought-tolerant varieties, water harvesting (for example under PMKSY watershed works)1-2 yearsHigh (survey-based)
Asset protectionLivestock loss reduction, crop loss reduction during extreme eventsEvent-dependentMedium (requires event coinciding with evaluation)
Livelihood diversificationNumber of income sources, non-farm income share2-3 yearsHigh
Institutional adaptive capacityPanchayat climate action plan, early warning system functionality1-3 yearsMedium (process-based)
Reduced vulnerability indexComposite vulnerability score (exposure, sensitivity, adaptive capacity)3-5 yearsMedium (construct validity concerns)
Worked example

Illustrative case: a watershed development programme in Maharashtra is evaluated for its climate adaptation value. The evaluation measures: (a) change in cropping pattern (shift to drought-resistant varieties), (b) groundwater recharge (well water levels pre-post monsoon), (c) income stability (coefficient of variation in income across years), and (d) coping strategy index during a drought year. The comparison is between watershed-treated and untreated villages in the same taluka.

Your Evaluability Framing

Fill these for your climate adaptation programme. Answers flow into the capstone.

e.g., "Climate-resilient agriculture programme, 5 blocks in Bundelkhand, UP, funded by a state climate fund"
Saved
Self-check
A climate programme distributes solar pumps to replace diesel pumps in Maharashtra. Is this adaptation, mitigation, or both?
Adaptation -- reduces climate vulnerability
Mitigation -- reduces emissions from diesel
Both, but the evaluation must measure each pathway separately -- emission reduction (mitigation) and whether solar pump reliability during grid outages improves irrigation during dry spells (adaptation)
Neither -- it is an energy programme
Correct. Solar pumps have co-benefits. But an evaluation claiming "climate impact" must specify which pathway it is measuring. The mitigation pathway (emissions) and adaptation pathway (irrigation reliability) require different indicators and different counterfactuals.
Module 2 . ~30 min

Vulnerability measurement under deep uncertainty

Climate vulnerability is a composite concept: Vulnerability = f(Exposure, Sensitivity, Adaptive Capacity). Each component is itself multi-dimensional. Measuring it as a single index is tempting but methodologically fraught.

The IPCC AR4 framework in practice

The index trap

Composite vulnerability indices (LVI, CVI, various SAPCC-based indices) are popular with funders because they produce a single number. But the weighting of sub-indicators is arbitrary, and small changes in weighting can reverse the conclusion. Better approach: report sub-indicators separately and show the direction of change in each, then construct the index as a summary only.

Deep uncertainty vs risk

Climate evaluation faces "deep uncertainty" -- we do not know the probability distributions of future climate events. A programme designed for 1.5 degrees C warming may fail at 2.5 degrees C. Your evaluation should explicitly state what climate scenario it is assessing against. Use IITM or CMIP6 downscaled projections for your district and specify the RCP/SSP pathway.

Your Vulnerability Measurement Plan

Design vulnerability measurement. These flow into your capstone.

e.g., "SSP2-4.5 downscaled for Bundelkhand, IITM projections to 2040"
Saved
Self-check
A vulnerability index shows your programme area's score improved from 0.62 to 0.54 (lower = less vulnerable). Can you conclude the programme reduced vulnerability?
Yes -- the index decreased, showing improvement
Not necessarily -- the index change could be driven by one sub-indicator, the weighting is arbitrary, and without a comparison area you cannot attribute the change to the programme
Only if the change is statistically significant
Yes, if you use the IPCC framework
Correct. Composite indices are summaries, not evidence. Report sub-indicators separately, compare to a control area, and test sensitivity to alternative weighting schemes before drawing conclusions.