fullscreen
ImpactMojoMixed Methods 101www.impactmojo.in
ImpactMojo 101 Series · Free Forever
Mixed
Methods
101
Intentionally Combining Quantitative & Qualitative Evidence in One Study — a Foundational Course for Development Researchers & MEL Practitioners in South Asia
Research-BackedSouth Asia Focus100 SlidesFree Access
CC BY-NC-ND 4.0 · ImpactMojo 101 Series01www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Agenda
What We Cover
01
What Mixed Methods Is
Slides 3–11
02
Why Mix? Five Purposes
Slides 12–20
03
Paradigms & Pragmatism
Slides 21–29
04
The Core Designs
Slides 30–38
05
Choosing a Design
Slides 39–46
06
Sampling in Mixed Methods
Slides 47–55
07
Integration: the Heart
Slides 56–64
08
Quality & Validity
Slides 65–73
09
Worked Examples
Slides 74–82
10
Common Pitfalls
Slides 83–91
11
Practice & Tools
Slides 92–99
CC BY-NC-ND 4.0 · ImpactMojo 101 Series02www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
01
Section One
What Mixed Methods Is
CC BY-NC-ND 4.0 · ImpactMojo 101 Series03www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Definition
Mixing is a choice, not an accident
Mixed methods research
Research that intentionally collects, analyses and integrates both quantitative and qualitative data within a single study or programme of inquiry — so the combination answers questions neither approach could answer alone.
The operative word is integration. Running a survey and some interviews in the same project is not yet mixed methods — it is two studies in a trench coat.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series04www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
More Than Both
Doing both is not the same as mixing both
Multi-method (parallel)
A quant strand and a qual strand sit side by side. Each is written up separately. They never meet. The reader does the integrating — if at all.
Mixed methods
The strands are deliberately connected: one informs the other, or they are merged and compared. Integration is designed in, and reported as a finding in its own right.
Ask of any 'mixed' study: where do the numbers and the words actually talk to each other?
CC BY-NC-ND 4.0 · ImpactMojo 101 Series05www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
The Promise
1 + 1 = 3
The case for mixing rests on a simple idea: integrated quantitative and qualitative findings yield insight greater than the sum of the parts. Numbers show the pattern; words explain the mechanism; together they make a claim each alone could only gesture at.
The combination of qualitative and quantitative methods can produce a more complete picture — the whole is greater than the sum of the parts.
— paraphrasing the '1 + 1 = 3' principle, mixed-methods literature
CC BY-NC-ND 4.0 · ImpactMojo 101 Series06www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Complementary Strengths
What each strand brings
Quantitative
  • Scale, prevalence, magnitude
  • Comparison across groups
  • Generalisable to a population
  • Tests hypotheses; measures effect
Qualitative
  • Meaning, process, context
  • Why and how, in whose words
  • Depth on the unexpected
  • Generates hypotheses; explains effect
Each method's weakness is the other's strength. Mixing is offsetting one set of blind spots with another.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series07www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
A Short History
From 'wars' to a third paradigm
01
1960s–80s: quant dominates; qual fights for legitimacy
→
02
1980s–90s: 'paradigm wars' — are the two even compatible?
→
03
1989: Greene et al. map five purposes for mixing
→
04
2000s: Creswell & Plano Clark codify designs; a 'third paradigm'
Mixed methods is now widely treated as a distinct methodology — not a truce, but a framework with its own logic.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series08www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
In Development
Why MEL practitioners reach for it
Development questions are stubbornly mixed. Did the programme work? is quantitative. For whom, why, and how? is qualitative. An impact figure without a mechanism is hard to act on; a rich story without scale is hard to defend.
  • Explain why an effect is large in one district, absent in another
  • Surface unintended consequences a survey never asked about
  • Give voice and context to a hard outcome number
  • Build instruments grounded in how people actually talk
CC BY-NC-ND 4.0 · ImpactMojo 101 Series09www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
What It Is Not
Three honest cautions up front
  • Not a quality guarantee. Two weak strands make one weak study, not a strong one.
  • Not 'qual to decorate quant'. A few quotes around a regression is not integration.
  • Not free. Mixing roughly doubles the skills, time and coordination required.
Mix because the question demands it — never because 'mixed methods' sounds rigorous in a proposal.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series10www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Roadmap
How this course is built
Foundations
  • Why mix; paradigms & pragmatism
  • The four core designs & notation
  • Choosing, sampling, integrating
Practice
  • Quality, validity & meta-inference
  • Worked development examples
  • Pitfalls, teams, tools, writing
Pairs with ImpactMojo's Qualitative Methods and Data Literacy 101 decks — this one is about combining them.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series11www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
02
Section Two
Why Mix? Five Purposes
CC BY-NC-ND 4.0 · ImpactMojo 101 Series12www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
The Framework
Greene, Caracelli & Graham's five purposes
The most-cited answer to 'why mix?' comes from a 1989 review by Jennifer Greene, Valerie Caracelli and Wendy Graham. They distilled mixed-methods studies into five distinct purposes — still the field's working vocabulary.
1
Triangulation
2
Complementarity
3
Development
4
Initiation
5
Expansion
Name your purpose before your design. The 'why' should drive the 'how'.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series13www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Purpose 1
Triangulation: do they agree?
Triangulation
Using two methods to study the same phenomenon, seeking convergence or corroboration — if both point the same way, confidence rises.
Survey data say child immunisation rose; FGDs with mothers independently describe easier access and more outreach visits. Two routes, one conclusion — the finding is more credible for it.
Watch the trap: when the two disagree, that is not a failure to fix — it is a finding to explain (see 'initiation').
CC BY-NC-ND 4.0 · ImpactMojo 101 Series14www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Purpose 2
Complementarity: a fuller picture
Here the methods examine different facets of the same issue, each elaborating the other. The aim is not agreement but richness — depth layered onto breadth.
A survey measures how many adolescent girls dropped out; interviews reveal the texture — menstruation, distance, safety, marriage. Neither replaces the other; together they explain the dropout.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series15www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Purpose 3
Development: one method builds the other
01
Qual first: interviews surface local categories & language
→
02
Use them to design a valid, grounded survey instrument
→
03
Quant then: measure prevalence at scale
→
04
Each strand sequentially informs the next
Development is sequential by definition: findings from method A shape method B — sampling, instruments or implementation.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series16www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Purpose 4
Initiation: provoke new questions
Initiation deliberately looks for contradiction and paradox between strands — the friction that reframes the question and sparks fresh insight.
Survey: satisfaction with the clinic is high. Interviews: people are quietly furious about waiting times. The dissonance is the discovery — perhaps 'satisfaction' measured low expectations, not good service.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series17www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Purpose 5
Expansion: extend the breadth
Expansion uses different methods for different components of an inquiry — commonly quant for outcomes and qual for process — to extend the study's range, not to study one thing two ways.
Classic in evaluation: measure the impact (quant) and evaluate how implementation actually unfolded (qual) within the same study.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series18www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Side by Side
The five purposes at a glance
PurposeCore questionStrands
TriangulationDo independent methods converge?Same phenomenon
ComplementarityCan one enrich the other?Overlapping facets
DevelopmentCan one build the other?Sequential, A → B
InitiationWhere do they contradict?Tension sought
ExpansionCan we widen the scope?Different components
Source: Greene, Caracelli & Graham (1989), Toward a Conceptual Framework for Mixed-Method Evaluation Designs.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series19www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Using It
From purpose to a design decision
  • Triangulation → collect concurrently, then compare
  • Development → collect sequentially, A informs B
  • Complementarity / Expansion → embed one within the other
  • Initiation → stay open; let contradiction redirect you
The purpose points at the design; the next sections turn that into concrete blueprints.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series20www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
03
Section Three
Paradigms & Pragmatism
CC BY-NC-ND 4.0 · ImpactMojo 101 Series21www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Why It Comes Up
Methods carry worldviews
Paradigm
A shared set of beliefs about what reality is (ontology) and how we can know it (epistemology) — the worldview a research approach is built on.
Quantitative work grew from post-positivism (one measurable reality); much qualitative work from constructivism (realities are socially constructed). Mixing seems to ask one study to hold two worldviews at once.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series22www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Two Worldviews
Post-positivism vs constructivism
Post-positivismConstructivism
RealityOne, measurableMultiple, constructed
Knower & knownSeparate, objectiveIntertwined, situated
GoalExplain, predict, generaliseUnderstand, interpret meaning
Typical methodSurvey, experimentInterview, ethnography
LogicDeductive, test theoryInductive, build theory
Stated this starkly, the two look irreconcilable — which is exactly the objection mixed methods had to answer.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series23www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
The Objection
The incompatibility thesis
Incompatibility thesis
The claim that quantitative and qualitative methods rest on opposed, irreconcilable paradigms — so combining them in one study is philosophically incoherent.
If methods are welded to worldviews, the argument runs, you cannot honestly mix them. This was a central charge in the 'paradigm wars' of the 1980s.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series24www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
The Answer
Pragmatism: the home of mixed methods
Mixed-methods scholars — notably Tashakkori & Teddlie — answered with pragmatism: choose methods by what works for the research question, not by allegiance to a paradigm.
The research question is more important than either the method or the philosophical worldview that underlies it.
— the pragmatist stance, after Tashakkori & Teddlie
CC BY-NC-ND 4.0 · ImpactMojo 101 Series25www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Pragmatism
What pragmatism actually claims
  • Knowledge is judged by its consequences and usefulness
  • The forced choice between objective and subjective is false
  • Methods are tools — pick the fit-for-purpose one
  • What 'works' to answer the question is the test of a good design
Pragmatism does not deny paradigms exist — it denies they must dictate your toolkit. The question is sovereign.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series26www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Stances
More than one way to hold the paradigms
A-paradigmatic / pragmatist
Set the philosophy aside; let the question and the practical payoff decide. The mainstream mixed-methods position.
Dialectical
Deliberately hold opposing paradigms in tension, mining the friction for insight — close kin to 'initiation'.
Other researchers adopt a transformative stance, foregrounding equity and the standpoint of marginalised groups throughout the design.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series27www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Common Ground
The two strands share more than they fight over
  • Both seek to reduce error and rule out alternative explanations
  • Both rely on systematic, transparent procedures
  • Both can be done well or badly — rigour is method-agnostic
  • Both ultimately serve better understanding for decisions
Once you see the shared commitments, combining the methods looks less like a contradiction and more like good sense.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series28www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Takeaway
You can mix — with eyes open
The incompatibility thesis is answered, not ignored. You may mix methods coherently — provided you can say why your question needs both and how you will reconcile what they tell you.
Philosophy earns its keep here: it forces you to be explicit about your stance, so reviewers can judge the study on its own terms.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series29www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
04
Section Four
The Core Designs
CC BY-NC-ND 4.0 · ImpactMojo 101 Series30www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
A Shared Language
The notation of mixed methods
Creswell & Plano Clark gave the field a compact notation for describing designs. Learn these four marks and you can write any design in a line.
SymbolMeaning
QUAN / QUAL (caps)The dominant, prioritised strand
quan / qual (lower)The secondary, supporting strand
+ (plus)Strands run concurrently, at the same time
→ (arrow)Strands run sequentially, one then the next
Two questions define every design: timing (+ or →) and priority (which is in caps).
CC BY-NC-ND 4.0 · ImpactMojo 101 Series31www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Design 1
Convergent parallel: QUAN + QUAL
QUANcollect & analyseQUALcollect & analyse+MERGE &COMPARE
Both strands run at the same time, with equal weight; results are merged and compared at interpretation. Best for triangulation.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series32www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Design 2
Explanatory sequential: QUAN → qual
QUANsurvey & resultsexplainqualfollow-up interviewsinterpret
Quant comes first and leads; qualitative follow-up explains the numbers — surprising results, outliers, group differences. The most common design in evaluation.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series33www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Design 3
Exploratory sequential: QUAL → quan
QUALexplore & themesbuildquaninstrument & testinterpret
Qualitative comes first and leads; it builds a grounded instrument or typology the quantitative strand then tests at scale. Matches the 'development' purpose.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series34www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Design 4
Embedded: one strand inside another
QUAN — e.g. a trial / RCT (the larger design)qualembedded process strand
A supportive strand is nested inside a dominant design — classically a qualitative process evaluation embedded within an experiment, asking a different but related question.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series35www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Four Designs
The core designs, compared
DesignNotationTimingBest for
Convergent parallelQUAN + QUALConcurrentTriangulation, fuller picture
Explanatory sequentialQUAN → qualSequentialExplaining numbers
Exploratory sequentialQUAL → quanSequentialBuilding instruments
EmbeddedQUAN(qual)EitherAdding a different sub-question
Source: Creswell & Plano Clark, Designing and Conducting Mixed Methods Research. Real studies often combine or extend these.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series36www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Beyond the Four
Complex & multiphase designs
The four are building blocks. Large programmes chain them into multiphase designs — an exploratory phase to build tools, a convergent phase to evaluate, an explanatory phase to interpret — across years.
You are not picking one design forever. You are choosing the right pattern for this question, then connecting patterns as a programme matures.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series37www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Read a Notation
Practice: what does this study do?
QUAL → QUAN
Sequential, equal weight, qual first. Explore to build a survey, then weight both strands equally at interpretation.
quan + QUAL
Concurrent, qualitative-led, with a smaller supporting quantitative strand running alongside.
Caps = priority, position = order, the connector = timing. Three marks, the whole design.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series38www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
05
Section Five
Choosing a Design
CC BY-NC-ND 4.0 · ImpactMojo 101 Series39www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Start Here
The question chooses the design
Do not start from 'I want to do mixed methods'. Start from the question, and let three sub-questions point you to a design: which order, which priority, which point of contact.
01
What do I actually need to know?
→
02
Which method leads — and does the other follow or run alongside?
→
03
Which strand carries more weight for this claim?
→
04
Where will the strands meet?
CC BY-NC-ND 4.0 · ImpactMojo 101 Series40www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Decision 1
Which order? Timing of the strands
Concurrent ( + )
Collect both at once. Faster; suits triangulation. But the strands cannot inform each other's design.
Sequential ( → )
One finishes before the next begins, so A shapes B. Slower; suits building and explaining.
If you need one strand to design the other, you must go sequential — time it into the workplan early.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series41www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Decision 2
Which priority? Weighting the strands
Priority is which strand carries the main analytic load — signalled by the CAPS in the notation. It follows from the question, not from which method you find easier or fund more.
  • QUAN-led: the headline claim is about magnitude or impact
  • QUAL-led: the headline claim is about meaning or process
  • Equal: both claims matter and stand together
A frequent failure is unstated priority: a qual strand quietly demoted to decoration. Decide weighting openly, in advance.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series42www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Decision 3
Where will the strands meet?
Every mixed design must name its point(s) of integration — where numbers and words actually connect. A design with no such point is multi-method, not mixed.
  • At design: one strand builds the other's sampling/instrument
  • At data: one dataset is transformed to join the other
  • At analysis / interpretation: merge, compare, joint display
CC BY-NC-ND 4.0 · ImpactMojo 101 Series43www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
A Chooser
If your aim is… pick…
Your aimLikely design
Corroborate a finding two waysConvergent parallel (QUAN + QUAL)
Explain surprising survey resultsExplanatory sequential (QUAN → qual)
Build a context-valid instrumentExploratory sequential (QUAL → quan)
Understand how a trial played outEmbedded (QUAN with qual process strand)
Provoke new questions from tensionConcurrent, dialectical stance
CC BY-NC-ND 4.0 · ImpactMojo 101 Series44www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Constraints
Be honest about feasibility
  • Time: sequential designs need two field rounds — budget the gap
  • Team: do you have both quant and qual skills, or must you hire?
  • Money: mixing roughly doubles instruments, training, analysis
  • Access: can you return to the same site for the second strand?
An elegant design you cannot resource becomes a poor one in practice. Match ambition to capacity.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series45www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Write It Down
Specify the design before fieldwork
Pin the design in your protocol: the notation, the purpose, the priority, the timing and — above all — the planned point of integration. This is your defence against drift.
A one-line design statement — 'QUAN → qual explanatory, integrated via joint display' — tells a reviewer in seconds what you are doing and why. And document deviations as they happen: an honest account of how the design evolved beats a too-tidy one.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series46www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
06
Section Six
Sampling in Mixed Methods
CC BY-NC-ND 4.0 · ImpactMojo 101 Series47www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Two Logics
Sampling pulls in opposite directions
Quant sampling
Probability, larger n, aims for representativeness so findings generalise to a population.
Qual sampling
Purposive, smaller n, aims for information-richness — cases chosen because they illuminate the question.
Mixed methods must hold both logics at once — and decide how the two samples relate.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series48www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Key Choice
Concurrent vs sequential sampling
  • Concurrent: draw both samples independently, around the same time — they need not overlap
  • Sequential: draw the second sample from the results of the first — the order creates the link
Sequential sampling is where mixing earns its keep: the first strand tells you whom the second should talk to.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series49www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Nested Samples
Drawing the qual sample from the quant
Nested sample
A sample for one strand drawn as a subset of the other strand's sample — e.g. interviewing a purposive selection of survey respondents.
In an explanatory design, you might survey 1,200 households, then interview 30 chosen from them — deliberately spanning high and low outcomes to explain the spread.
Nesting lets you link a person's numbers to their words — the tightest form of integration at the case level.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series50www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Selecting Cases
Whom to follow up — on purpose
  • Extreme cases: the biggest gainers and the non-responders
  • Typical cases: households near the median, to ground the norm
  • Confirming / disconfirming: cases that test the emerging story
  • Maximum variation: span the range deliberately
The survey gives you a sampling frame for the interviews that no convenience approach could match — use it.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series51www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Sizing
How big should each strand be?
Quant: powered
Size for the precision or power the claim needs — margin of error, effect size, subgroups.
Qual: saturation
Size for saturation — keep sampling until new interviews stop yielding new themes.
Do not judge the qual strand by quant logic. 'Only 25 interviews?' is the wrong question if those 25 reached saturation.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series52www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Frame Matters
Mind the gap between the two frames
If the survey frame and the interview frame differ — different villages, different eligibility — your integration compares apples and oranges. Make the relationship between frames explicit.
Best practice in development MEL: sample the qualitative cases from within the quantitative sites, so context and outcomes line up.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series53www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Equity Lens
Sample to see the excluded
A representative survey can still drown out small, marginalised groups. Purposive qualitative sampling is how you deliberately over-listen to those the averages bury — Dalit, Adivasi, disabled, migrant respondents.
Mixed methods can correct for whom the numbers miss — but only if you design the qual sample to do exactly that.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series54www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Plan It
A sampling plan for both strands
  • State each strand's frame, method and target size, and the rationale
  • State whether the samples are independent, nested or identical
  • If sequential, state the rule for selecting the second from the first
  • Name how the two samples will be linked at analysis
CC BY-NC-ND 4.0 · ImpactMojo 101 Series55www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
07
Section Seven
Integration: the Heart
CC BY-NC-ND 4.0 · ImpactMojo 101 Series56www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
The Core Idea
Integration is what makes it mixed
Integration
The deliberate point(s) at which the quantitative and qualitative strands are brought together — connected, merged or embedded — so that the combination yields more than the strands apart.
If you can remove either strand and the conclusions barely change, you never really integrated. Integration is the test of a genuine mixed-methods study.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series57www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Three Ways
Connecting, merging, embedding
ApproachHow it worksTypical design
ConnectingOne strand's results lead into the nextSequential designs
MergingBring both datasets together to compareConvergent parallel
EmbeddingOne strand nested to support the otherEmbedded design
These map onto the designs: the design you chose already implies how you will integrate.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series58www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Tool 1
The joint display
A joint display is a single table or figure that arrays quantitative and qualitative results side by side around a common organising principle — the workhorse of integration.
Sub-groupQUAN: outcomeQUAL: why (illustrative)Meta-inference
High-uptake blockUptake ~80%"The ASHA visits every week"Frontline contact drives uptake
Low-uptake blockUptake ~35%"The centre is two hours away"Distance, not awareness, is the barrier
The right-most column — the meta-inference — is the integration. The numbers and quotes only set it up.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series59www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Tool 2
Following a thread
Following a thread starts from a striking finding in one strand and traces it deliberately through the other — weaving a single line of argument across both datasets.
01
Spot a surprising survey result (a sharp gender gap)
→
02
Pull the thread into the interviews on that theme
→
03
Return to the data to test what the interviews suggest
→
04
Report one integrated narrative, not two
CC BY-NC-ND 4.0 · ImpactMojo 101 Series60www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Tool 3
Data transformation
  • Quantitising: turn qualitative codes into counts — 'how many interviewees raised distance?' — to merge with survey data
  • Qualitising: turn quantitative profiles into narrative typologies — 'the reluctant adopter' — to compare with cases
Powerful but lossy: counting themes can strip their meaning. Transform with care, and keep the original alongside.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series61www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
When They Agree
Convergence builds confidence
When both strands point the same way, you have convergence — the strongest, most reassuring outcome of integration. The claim now rests on two independent legs.
Report convergence explicitly: 'survey and interviews independently identified distance as the binding constraint' is a stronger sentence than either finding alone.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series62www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
When They Clash
Divergence is a finding, not a failure
When strands disagree, resist the urge to pick a winner or bury the conflict. Dissonance often exposes a flaw in one measure — or a deeper truth the averages hid.
  • Re-examine both measures: which question were they really answering?
  • Look for the subgroup or context that reconciles them
  • Report the tension honestly — it is frequently the best insight
CC BY-NC-ND 4.0 · ImpactMojo 101 Series63www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
The Payoff
Meta-inferences: the 1 + 1 = 3
Meta-inference
An overall conclusion drawn by integrating the inferences from both strands — a claim that neither the quantitative nor the qualitative analysis could have reached alone.
The meta-inference is the deliverable of mixed methods. If your write-up has none — only a results section per strand — the integration has not happened yet.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series64www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
08
Section Eight
Quality & Validity
CC BY-NC-ND 4.0 · ImpactMojo 101 Series65www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
A Harder Bar
Three quality questions, not one
A mixed study must satisfy quality on three fronts: the quant strand on its own terms, the qual strand on its own terms, and — uniquely — the quality of the integration itself.
01
Is the QUAN strand rigorous? (validity, reliability, power)
→
02
Is the QUAL strand rigorous? (credibility, transferability)
→
03
Is the MIXING rigorous? (does integration add genuine value?)
CC BY-NC-ND 4.0 · ImpactMojo 101 Series66www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Each Strand
Hold each to its own standard
ConcernQuantitative termQualitative term
Truth valueInternal validityCredibility
ApplicabilityExternal validityTransferability
ConsistencyReliabilityDependability
NeutralityObjectivityConfirmability
Do not impose quant criteria on the qual strand or vice versa. Each tradition has its own well-developed standards — use them.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series67www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
The Mixing Standard
Legitimation
Legitimation
The validity framework specific to mixed methods (Onwuegbuzie & Johnson): the extent to which combining the strands yields credible, defensible meta-inferences.
Where single-method work asks 'is this valid?', mixed methods adds: 'is the integration legitimate?' — a distinct question Tashakkori & Teddlie also pushed the field to formalise.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series68www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Legitimation Types
Ways integration can go wrong
  • Sample integration: do the two samples support a joint claim?
  • Weakness minimisation: does each strand cover the other's gaps?
  • Conversion: is quantitising / qualitising done faithfully?
  • Political: are conflicting findings reconciled honestly, not by fiat?
Each is a place to interrogate your own study before a reviewer does.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series69www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Two Dimensions
Design quality vs interpretive rigour
Design quality
Is the design suitable, adequate and faithfully implemented? Did the strands actually run as planned, with the integration point intact?
Interpretive rigour
Do the meta-inferences truly follow from the integrated evidence? Are they consistent, plausible and not over-reaching?
After Tashakkori & Teddlie's inference quality: a good design badly interpreted — or vice versa — still fails.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series70www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Strengthen It
Practices that raise quality
  • Pre-specify the design, priority and integration point in a protocol
  • Use joint displays so integration is visible and checkable
  • Triangulate — and report divergence, do not hide it
  • Member-check qualitative findings; report quant uncertainty
  • Keep an audit trail of decisions across both strands
CC BY-NC-ND 4.0 · ImpactMojo 101 Series71www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Reporting
Report the mixing, not just the methods
Reporting guidance (e.g. GRAMMS — Good Reporting of A Mixed Methods Study) asks you to justify the design, describe each strand, and crucially show where and how you integrated.
Common reviewer complaint: a paper reports two strands but never the integration. State the meta-inference explicitly, or the mixing is invisible.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series72www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Bottom Line
Quality is mostly about integration
A mixed study can have a flawless survey and superb interviews and still be weak — if the two never genuinely meet. The distinctive quality question is always: did mixing add value, defensibly?
Judge the join, not just the parts. That is what separates mixed methods from two studies stapled together.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series73www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
09
Section Nine
Worked Examples
CC BY-NC-ND 4.0 · ImpactMojo 101 Series74www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Example 1
An RCT with an embedded process evaluation
A cash-transfer programme is tested with a randomised trial (QUAN). Nested inside is a qualitative process evaluation (qual): how was the cash spent, who in the household decided, what got in the way?
Notation: QUAN(qual), embedded. The trial measures whether it worked; the embedded strand explains why, and flags whether the mechanism matched the theory of change.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series75www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Example 1, cont.
Why the qual strand earns its place
Trial alone says
'Consumption rose by X; the effect was larger for female-headed households.' True — but mute on mechanism.
Embedded qual adds
Women described controlling the transfer for the first time — explaining the heterogeneity the trial only detected.
The meta-inference — 'the effect ran through women's control of the cash' — needed both strands.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series76www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Example 2
A survey explained by follow-up interviews
A district health survey (QUAN) finds institutional delivery is high overall but stubbornly low in three blocks. Purposive follow-up interviews (qual) in those blocks explain the gap — an explanatory sequential design.
QUAN: survey finds3 blocks laggingqual: interviews therereveal the barrieract
CC BY-NC-ND 4.0 · ImpactMojo 101 Series77www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Example 2, joint display
Reading the two together
Institutional delivery by block (%) — illustrative
Illustrative, patterned on district HMIS-style data
Interviews (illustrative) attributed the three low blocks to a closed sub-centre and night-time transport fears — the meta-inference the bars alone could not give.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series78www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Example 3
Building an empowerment scale, locally
An exploratory sequential study (QUAL → quan): in-depth interviews first surface how women in a region actually describe agency — in mobility, money and voice. Those categories build a survey scale that is then validated at scale.
The payoff: an instrument grounded in local meaning, not imported from another context — the 'development' purpose in action, answering a validity problem head-on.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series79www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Example 4
Triangulating a corruption estimate
A convergent parallel study estimates leakage in a welfare scheme three ways at once: a household survey of benefits received, administrative records of benefits disbursed, and qualitative interviews on how diversion happens.
Where the three converge, confidence is high. Where the survey and records diverge, the interviews explain the gap — turning a discrepancy into the finding.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series80www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
RealWorld Evaluation
Mixing under real constraints
Michael Bamberger and colleagues (RealWorld Evaluation) argue mixed methods is often the most practical response to development reality: tight budgets, short timelines, no baseline, and political pressure.
  • Use existing secondary data to substitute for a missing baseline
  • Add a small qual strand to interpret a thin quant one (or vice versa)
  • Triangulate to compensate when no single method can be done fully
CC BY-NC-ND 4.0 · ImpactMojo 101 Series81www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Common Thread
What the examples share
In every case the value lives in the join: the trial needed the mechanism, the survey needed the explanation, the scale needed the local voice, the estimate needed corroboration. None is two studies side by side.
When you sketch your own study, write the meta-inference you hope to reach first — then check both strands are actually needed to get there.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series82www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
10
Section Ten
Common Pitfalls
CC BY-NC-ND 4.0 · ImpactMojo 101 Series83www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Pitfall 1
Parallel play: no integration
The commonest failure: a quant chapter and a qual chapter that never speak. Two methods were used; nothing was mixed. The reader is left to do the integration the authors avoided.
Diagnostic: delete one strand. If the conclusions survive intact, you had parallel play, not mixed methods.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series84www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Pitfall 2
Qual as decoration
A regression table dressed up with three illustrative quotes is not integration — it is garnish. The qualitative strand here adds colour but no independent evidence and no meta-inference.
Quotes should change what you conclude, not merely illustrate a number you already had. Otherwise the qual strand is doing no analytic work.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series85www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Pitfall 3
Unequal weighting by accident
Priority should be a decision, not a side-effect of which strand had more money or a more confident analyst. Too often the survey silently dominates and the interviews are demoted at write-up.
If the qual strand cost a third of the budget but gets one paragraph, ask whether priority was chosen — or just happened.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series86www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Pitfall 4
Under-estimating skills & time
Skills gap
Few researchers are equally strong in both traditions. A team weak on one side produces a lopsided study with a token strand.
Time gap
Sequential designs need two field rounds and the gap between. Budgets and timelines built for one method under-resource the second.
Plan for both costs up front — or the weaker strand becomes the decoration you did not intend.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series87www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Pitfall 5
Forcing methods the question doesn't need
Sometimes a single method answers the question best. Bolting on a second strand 'because mixed methods is rigorous' wastes resources and dilutes focus — methodolatry, not method.
The honest test: can you state a question that genuinely needs both? If not, do one method well rather than two methods thinly.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series88www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Pitfall 6
Ignoring divergence
When the strands disagree, the temptation is to quietly trust the numbers and shelve the interviews (or the reverse). Suppressing divergence throws away the study's most informative result.
Reviewers notice a too-tidy convergence. Report disagreement, and what you think it means — that is rigour, not weakness.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series89www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Pitfall 7
Vague design, mid-study drift
Without a pre-specified design, priority and integration point, a study drifts: the planned sequential link is skipped, the joint display never gets built, and 'mixed methods' becomes a label, not a method.
A one-line design statement in the protocol is the cheapest insurance against drift — write it before you collect a single data point.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series90www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Avoiding Them
A pre-flight checklist
  • Can I name the question that needs both strands?
  • Have I stated the design, priority and timing in notation?
  • Have I named the integration point — before fieldwork?
  • Does the team have real skills in both traditions?
  • Is there time and budget for the second strand, properly?
  • Will I report divergence as openly as convergence?
CC BY-NC-ND 4.0 · ImpactMojo 101 Series91www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
11
Section Eleven
Practice & Tools
CC BY-NC-ND 4.0 · ImpactMojo 101 Series92www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Build the Team
Mixing needs mixed skills
Few people do both traditions equally well, so most strong mixed-methods work is team work — pairing quant and qual specialists who genuinely respect each other's craft.
  • Bring both specialists into design, not just analysis
  • Agree the integration point together, early
  • Make space for the strands to challenge each other's findings
CC BY-NC-ND 4.0 · ImpactMojo 101 Series93www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Software
Tools for each strand — and the join
ToolGood forNote
R / PythonQuant analysis, reproducible workflowsFree, scriptable
Stata / SPSSSurvey analysis with weightsCommon in MEL shops
NVivo / ATLAS.tiCoding qualitative dataSupport joint-display matrices
DedooseBuilt for mixed-methods integrationLinks codes to variables
KoboToolbox / ODKCollecting both data types in the fieldFree, offline-capable
No tool integrates for you. Software stores and links the data; the meta-inference is still yours to make.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series94www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Writing It Up
Structuring a mixed-methods report
  • State the design and rationale in notation, up front
  • Report each strand clearly — but do not stop there
  • Devote a dedicated integration section to joint displays
  • Lead the discussion with the meta-inferences
  • Be explicit about convergence and divergence
If a reader can find your meta-inference in thirty seconds, the write-up has done its job.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series95www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Publishing
Getting mixed work past reviewers
Mixed-methods papers are often rejected for insufficient integration or for a strand judged thin by single-method reviewers. Pre-empt both: justify the mixing and show the join.
Use a reporting standard such as GRAMMS, and consider a journal or section that understands mixed designs — reviewers matched to the method judge it fairly.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series96www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Reading List
The foundational texts
  • Creswell & Plano Clark — Designing and Conducting Mixed Methods Research (the designs & notation)
  • Greene — Mixed Methods in Social Inquiry (purposes & the dialectical stance)
  • Tashakkori & Teddlie — Handbook of Mixed Methods (pragmatism, legitimation, inference quality)
  • Bamberger et al. — RealWorld Evaluation (mixing under development constraints)
CC BY-NC-ND 4.0 · ImpactMojo 101 Series97www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Go Deeper
Where to keep learning
  • Journal of Mixed Methods Research — the field's home journal
  • BetterEvaluation — practical mixed-methods guidance for MEL
  • 3ie & JPAL — evaluations that embed qual in trials
  • GRAMMS reporting criteria — a checklist for your write-up
Pair this deck with ImpactMojo's Qualitative Methods, Data Literacy and Theory of Change 101 courses.
CC BY-NC-ND 4.0 · ImpactMojo 101 Series98www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
The Takeaways
If you remember five things
  • Mix on purpose — intentional combination, not 'both at once'
  • Let the question choose the design — timing & priority
  • Integration is the heart — joint displays, meta-inferences
  • Divergence is a finding — never suppress it
  • 1 + 1 = 3 only when the strands genuinely meet
CC BY-NC-ND 4.0 · ImpactMojo 101 Series99www.impactmojo.in
ImpactMojoMixed Methods 101www.impactmojo.in
Mixed Methods 101 · Complete
Now make the
numbers and words
talk to each other.
Mixed methods is not doing both — it is designing the point where quantitative and qualitative evidence meet, so the whole exceeds the sum of its parts. Explore the rest of the ImpactMojo 101 Series, free forever.
More 101 CoursesExplore ImpactMojoDataverse
CC BY-NC-ND 4.0·Free Forever·ImpactMojo 101 Series
CC BY-NC-ND 4.0 · ImpactMojo 101 Series100www.impactmojo.in