fullscreen
ImpactMojoObservation to Insight 101www.impactmojo.in
ImpactMojo 101 Series · Free Forever
Observation
to Insight
101
Seeing What Surveys Miss — Field Observation as a Rigorous Method for Development Practitioners in South Asia
Method-BackedSouth Asia Focus100 SlidesFree Access
ImpactMojoObservation to Insight 101www.impactmojo.in
What We Cover
01
Why Observation Matters
Slides 3–11
02
Types of Observation
Slides 12–19
03
What to Observe
Slides 20–27
04
Field Notes
Slides 28–36
05
Structured Observation Tools
Slides 37–46
06
Sensemaking: Notes to Patterns
Slides 47–55
07
Triangulation
Slides 56–65
08
From Insight to Action
Slides 66–74
09
Bias & Rigour
Slides 75–83
10
Ethics of Observation
Slides 84–92
11
Practice & Tools
Slides 93–99
ImpactMojoObservation to Insight 101www.impactmojo.in
01
Section One
Why Observation Matters
ImpactMojoObservation to Insight 101www.impactmojo.in
Observation is data, not decoration
Most development evidence comes from what people tell us — surveys, interviews, self-reports. Observation is the disciplined practice of learning by watching what people actually do, in the real settings where they do it. It is a method with its own rigour, not a coffee break.
Observation
Systematically watching, listening to and recording behaviour, interactions and settings in the field — to understand what happens, not only what people say happens.
You do not need a clipboard to start. You need to be present, curious and honest about what you actually see.
Evidence sourceRecordsFails when
SurveyWhat people reportReporting differs from doing
InterviewWhat people can articulateThe practice is below awareness
Administrative recordWhat was written downThe register is aspirational
ObservationWhat actually happenedThe observer is present
Each method fails differently, which is the entire argument for using more than one. Observation is not more truthful than a survey — it is wrong about different things.
It is also the only method here that can surface something nobody thought to ask about. A survey returns answers to your questions; observation returns what is there.
ImpactMojoObservation to Insight 101www.impactmojo.in
The say–do gap
People do not always do what they say — not from dishonesty, but because memory is faulty, norms shape answers, and habits run below awareness. The say–do gap is the distance between reported and observed behaviour.
01
SAY: 'We always wash hands before eating'
02
DO: observed handwashing at far fewer meals
03
GAP: the difference is the finding
04
OBSERVE: only watching reveals it
Why the say–do gap opensNot because
Memory reconstructs rather than replaysPeople are lying
Norms shape what is sayableThey are being evasive
Habits run below awarenessThey do not know their own lives
The question implies a right answerThey misunderstood
Treating the gap as dishonesty is the error that ruins the finding. A respondent reporting they wash their hands is usually reporting the practice they endorse, which is real information about norms.
So the gap has two readings: what people do, and what they believe they should do. Both matter, and only having the two together tells you which is which.
ImpactMojoObservation to Insight 101www.impactmojo.in
Reported vs observed handwashing
Self-reported vs observed handwashing before meals
ILLUSTRATIVE — figures invented to show the pattern, not real data
ILLUSTRATIVE numbers. The point is the shape: reported practice sits well above observed practice. Programmes built on self-report alone can chase a behaviour that is not there.
ImpactMojoObservation to Insight 101www.impactmojo.in
The questionnaire never asked
  • The unspoken: a clinic queue where men are served before women
  • The unmeasured: the broken hand-pump nobody listed as a problem
  • The contextual: who sits where, who speaks, who stays silent
  • The routine: habits so normal that respondents forget to mention them
A survey can only return answers to questions you already knew to ask. Observation surfaces the questions you did not.
CategoryExampleWhy a survey misses it
The unspokenMen served before women in a queueNobody would report it as a problem
The unmeasuredA broken hand-pump on no listIt is not in the instrument
The contextualWho sits where in a meetingNot a variable
The routineThe workaround everyone usesToo ordinary to mention
The routine is the richest category and the hardest to see. Practices so ordinary that nobody would think to describe them are exactly what a newcomer with a notebook can catch.
It is also why prolonged engagement matters. In the first week you see everything and understand none of it; by the fourth you understand it and have stopped noticing.
ImpactMojoObservation to Insight 101www.impactmojo.in
Where observation fits among methods
MethodAnswersBlind spot
SurveyHow many / how widespreadOnly what you knew to ask
InterviewWhat people say & why they say itSay–do gap; recall error
Document reviewWhat is officially recordedWhat records omit or inflate
ObservationWhat people actually do, in contextHard to scale; observer effect
Observation is not better than the others — it sees what they cannot. That is why it earns a place in any serious study.
MethodAnswersBlind spot
SurveyHow many, how widespreadOnly what you knew to ask
InterviewWhat people say and whySay–do gap; recall
RecordsWhat was written downWritten under incentives
ObservationWhat actually happenedYour presence; a few sites
No method here is more truthful than the others. Each is reliable about one thing and unreliable about another, which is why triangulation is a design decision rather than a luxury.
Choose by what your question needs. If you need prevalence, observation cannot give it; if you need mechanism, a survey cannot.
ImpactMojoObservation to Insight 101www.impactmojo.in
The value of simply being there
Time in the field builds tacit understanding — the feel of a place, its rhythms, its tensions. Much of what matters in development is relational and spatial, and only becomes visible to someone who lingers.
You can observe a lot just by watching.
— attributed to Yogi Berra
Being present gives youWhich cannot be got from data
The rhythm of a placeWhen things happen, and when nothing does
Spatial relationsWho is near the centre, who is at the edge
Tone and tensionWhat is not said in a meeting
Credibility with the people thereThey have seen you show up
The last row is instrumental as well as ethical. Observers who have been present repeatedly are told things that a one-day visitor with a questionnaire never hears.
Tacit understanding is real and is not evidence. It should shape which questions you ask and what you look for — not appear in the findings as a claim.
ImpactMojoObservation to Insight 101www.impactmojo.in
Observation across the project cycle
StageWhat observation adds
Needs assessmentSurfaces problems people don't name in surveys
DesignGrounds the intervention in real routines and constraints
ImplementationShows how a programme is actually used, not just delivered
MonitoringCatches gaps between protocol and practice early
EvaluationExplains why outcomes happened, not only whether
Project stageWhat observation adds
Needs assessmentProblems nobody names in a survey
DesignThe real routines an intervention must fit
ImplementationWhether it is happening as designed
MonitoringWhy an indicator moved, or did not
EvaluationThe mechanism behind the result
The implementation row is the one most under-used. Most programmes discover a delivery problem at evaluation, when a half-day of observation in month three would have found it.
Light, routine observation built into supervision is worth more than an occasional rigorous study, because it corrects the programme while there is still time.
ImpactMojoObservation to Insight 101www.impactmojo.in
Observation is powerful, not infallible
Watching is interpretation. Two observers can see the same scene and record different things. The rest of this course is about making observation systematic, transparent and ethical — so it earns the word 'evidence'.
Good observation is not 'just looking'. It is looking with a question, a method, and a record.
Observation riskWhat makes it systematic instead
Two observers see different thingsDefined categories; inter-observer checks
You see what you expectActively seeking disconfirming cases
Presence changes behaviourProlonged engagement; naming the effect
Interpretation smuggled into the recordLow-inference descriptive notes
Watching is interpretation, and the response is not to stop interpreting but to separate the layers. Every technique in this deck exists to keep the description recoverable from the reading.
The rest of the course is essentially this table expanded. Each risk gets a discipline, and none of the disciplines removes the risk — they make it visible and checkable.
ImpactMojoObservation to Insight 101www.impactmojo.in
02
Section Two
Types of Observation
ImpactMojoObservation to Insight 101www.impactmojo.in
Three choices define your observation
Every observation sits on three axes. Decide each one deliberately before you enter the field — they shape what you can see and what you owe the people you watch.
Role
Participant ↔ non-participant
Structure
Structured ↔ unstructured
Disclosure
Overt ↔ covert
AxisOptionsDecides
RoleParticipant ↔ non-participantHow much you see and how much you change
StructureStructured ↔ unstructuredWhether you can count or discover
DisclosureOvert ↔ covertWhat you owe the people observed
The three are independent and are usually decided by default rather than deliberately. Most field observation drifts into non-participant, semi-structured and overt without anyone having chosen it.
State all three in the methods section. A reader cannot judge findings without knowing whether you joined in, whether you had a checklist, and whether people knew.
ImpactMojoObservation to Insight 101www.impactmojo.in
The participant↔non-participant spectrum
CompleteparticipantParticipant-as-observerObserver-as-participantCompleteobserverdeep immersionpure watching
Gold & others mapped this classic continuum. More participation buys you depth and trust; less buys you distance and a wider view. You will often move along it within one study.
Position on the spectrumYou are
Complete participantA member; observing covertly
Participant-as-observerTaking part, known as a researcher
Observer-as-participantMostly watching, some involvement
Complete observerDetached; possibly unnoticed
Gold’s continuum dates from 1958 and still frames the choice. Its value is in forcing the decision: most fieldwork drifts to the third position without anyone selecting it.
You will move along it during a study, and that is fine as long as you record when and why. Undocumented drift is what makes a methods section unverifiable.
ImpactMojoObservation to Insight 101www.impactmojo.in
Participant observation
The observer takes part in the life of the setting — joining a self-help group meeting, working a shift, sharing a meal — while observing. The anthropologist's classic stance.
Gains
  • Trust and access insiders never grant outsiders
  • Felt, embodied understanding of routines
  • The unguarded, backstage moments
Costs
  • Time-intensive — weeks or months
  • Risk of 'going native' and losing distance
  • Your presence changes the scene
Participant observation givesAt the cost of
Access to what insiders seeYour presence changes the setting
Understanding through doingDifficulty taking notes in the moment
Trust over timeTime — months, not days
Tacit knowledgeRisk of going native
Note-taking is the practical constraint people underestimate. You cannot participate in a self-help group meeting and write continuously, so jotted notes and same-day expansion become non-negotiable.
Decide in advance what you will do if participating means witnessing something you should act on. That situation arrives more often than the methods literature suggests.
ImpactMojoObservation to Insight 101www.impactmojo.in
Non-participant observation
The observer stays apart — watching a school classroom from the back, timing a clinic queue, mapping a market — without joining in. More detached, more easily structured.
Gains
  • Cleaner, more comparable records
  • Less time per site; cover more sites
  • Easier to standardise across observers
Costs
  • Surface view — misses meaning
  • Less trust, less backstage access
  • A watcher in the corner still alters behaviour
Non-participant observationSuits
Timing a clinic queueCounting, comparing across sites
Watching a classroom from the backStructured tallies
Mapping a marketSpatial patterns
Anything needing comparabilityBecause you are not changing it
Detachment buys comparability and costs understanding. You can count what happens in the queue and you will not learn why people accept the order they are served in.
It is also more visible than it feels. Someone sitting at the back of a classroom with a clipboard is an event in that classroom, whatever they intend.
ImpactMojoObservation to Insight 101www.impactmojo.in
Structured vs unstructured
StructuredUnstructured
ToolChecklist, coding sheet, timerOpen field notebook
QuestionPre-defined — you know what to countOpen — you discover what matters
OutputCounts, ratings, frequenciesRich descriptive narrative
Best forComparison, monitoring, scaleExploration, meaning, the unexpected
RiskMisses what's not on the sheetHard to compare across sites
Many studies start unstructured (to learn what to look at) and then add structure (to count it reliably).
StructuredUnstructured
RequiresKnowing what matters alreadyNothing decided in advance
OutputCounts, comparable across sitesNarrative, rich in context
StrengthComparison and trackingDiscovery
Blind spotAnything outside the categoriesCannot be aggregated
Right forMonitoringNeeds assessment
The sequence usually runs unstructured then structured. You cannot build a valid checklist until open observation has told you what belongs on it — and checklists built from assumptions count the wrong things well.
Many field studies invert this because the checklist is easier to plan and budget. The result is a precise count of categories that turned out not to matter.
ImpactMojoObservation to Insight 101www.impactmojo.in
Overt vs covert
Overt
People know they are being observed and have consented. The ethical default. Costs you some of the natural behaviour you came to see (the observer effect).
Covert
People do not know they are observed. Yields unguarded behaviour — but denies consent and carries serious ethical and legal risk. Rarely justifiable in development work.
Default to overt. Covert observation needs an exceptional justification and ethics-committee approval — we return to this in Section 10.
OvertCovert
ConsentGivenImpossible
Observer effectPresent, decays with timeAbsent
Ethical statusThe defaultRequires exceptional justification
ApprovalRoutineRarely granted
Risk if discoveredNoneSevere, and borne by those observed
The observer effect decays with prolonged engagement, which removes most of the argument for covert work. People cannot sustain performance for weeks, so time buys what deception was meant to buy.
Covert observation in public space is a different case from covert observation in private or semi-private settings. Section 10 sets the bar; it is high, and it is rarely met.
ImpactMojoObservation to Insight 101www.impactmojo.in
Match the type to the question
  • Want meaning and process? Lean participant and unstructured.
  • Want comparable counts across sites? Lean non-participant and structured.
  • Watching a private or sensitive setting? Overt, with consent, always.
  • Most real studies blend these, and shift as understanding grows.
There is no single 'best' type — only the type that fits your question, your ethics and your time.
Your questionLean toward
How does this actually work?Participant, unstructured
How do sites compare?Non-participant, structured
Does the register match reality?Non-participant, structured, brief
Why does uptake differ here?Participant, then interviews
Anything private or sensitiveProbably not observation at all
The last row is the one to hold onto. Some questions should not be answered by watching, and choosing observation because it is available rather than appropriate is a real risk in field work.
Match the type to the question before the fieldwork is scheduled. The type decides the time required, and a design chosen after the calendar is fixed will be chosen by the calendar.
ImpactMojoObservation to Insight 101www.impactmojo.in
03
Section Three
What to Observe
ImpactMojoObservation to Insight 101www.impactmojo.in
A field site overwhelms the eye
Stand in a busy market, an anganwadi, a gram sabha — a thousand things happen at once. Without a framework you record randomly, miss patterns, and tire fast. You need a lens that tells you what to look at.
The cure for overwhelm is not to watch harder. It is to watch with a structure.
Without a frameworkWith one
You record what catches the eyeYou record what you decided matters
Patterns are missedPatterns accumulate across sessions
Two observers diverge wildlyThey can be compared
You tire in an hourYou can sustain a session
Fatigue is the practical argument nobody mentions. Unstructured watching of a busy setting is exhausting, and the quality of what you record falls sharply after the first hour.
Plan sessions of a length you can actually sustain, with breaks to write. Three good forty-minute observations beat one unfocused half-day.
ImpactMojoObservation to Insight 101www.impactmojo.in
Spradley's nine dimensions of a social situation
James Spradley (Participant Observation, 1980) gave fieldworkers a checklist of nine dimensions present in any social situation. Run through them and you will rarely miss something important.
DimensionAsk…
SpaceThe physical place — layout, boundaries
ActorsThe people present — who, how many
ActivitiesThe set of related acts people do
ObjectsThe physical things present
ActsSingle actions people take
EventsThe activities bundled into occasions
TimeSequencing — what happens over time
GoalsWhat people are trying to accomplish
FeelingsEmotions felt and expressed
Spradley dimensionAsk
SpaceWhat is the physical place like?
ActorsWho is here, and who is not?
ActivitiesWhat is being done?
Acts, events, timeWhat actions, sequences and rhythm?
Goals, feelingsWhat are people trying to do, and how do they seem?
Run through all nine before narrowing. The dimensions you would not have chosen — objects, time, feelings — are where the unexpected findings usually sit.
"Who is not here" belongs under actors and is the single most productive question in the list. Absence is a finding, and no framework built from what is present will prompt it.
ImpactMojoObservation to Insight 101www.impactmojo.in
Spradley's 'grand-tour' observation
Spradley advised starting with a grand-tour: a broad sweep that takes in the whole setting before zooming in. Walk the space, map it, get the lay of the land — then narrow to a mini-tour of one corner in detail.
01
GRAND-TOUR: scan the whole setting
02
MAP: space, actors, objects
03
MINI-TOUR: zoom in on one activity
04
FOCUS: follow the question that emerges
Grand tour firstBecause
Walk and map the whole spaceSpatial patterns are invisible from one spot
Note who is present and absentAbsence is a finding
Get the rhythm of a full cycleA snapshot is not typical
Only then narrow the focusYou now know what to focus on
Absence is the finding most often missed. Who is not at the anganwadi, not at the gram sabha, not in the queue — and a framework built from what is present will never prompt you to look.
Spradley published the nine dimensions and the grand-tour approach in Participant Observation (1980). The sequence — broad, then focused, then selective — is the durable part.
ImpactMojoObservation to Insight 101www.impactmojo.in
The nine dimensions at an anganwadi
DimensionAt an anganwadi centre
SpaceOne room; cooking corner; mat for children
ActorsWorker, helper, 18 children, two mothers
ActivitiesMeal service, weighing, pre-school play
ObjectsGrowth chart, weighing scale, ration sacks
ActsA child refuses food; worker records weight
EventsThe hot-cooked-meal session
TimeChildren arrive late; meal slips past schedule
GoalsNutrition, school-readiness, attendance
FeelingsRestlessness; a mother's worry over weight
DimensionAt an anganwadiQuestion it raises
SpaceOne room; cooking corner; a matWho sits where?
ActorsWorker, helper, 18 children, two mothersWhich mothers, and where are the others?
ActivitiesMeal service, weighing, registerIn what order, and why that order?
TimeMeal, then weighingDo mothers stay for the second?
The fourth row is where a finding is hiding. If weighing follows the meal and mothers leave after it, growth monitoring silently fails — and the register may not show it.
That is the pattern this deck returns to: the sequence of activities, not their presence, is what determines whether a service reaches people.
ImpactMojoObservation to Insight 101www.impactmojo.in
Draw the space
A simple sketch map — doorways, seating, the queue, where the worker stands — captures spatial patterns words cannot. Who sits near the front? Who is pushed to the margins? Space encodes power.
Keep a sketch map in every field notebook. Mark movement with arrows; mark where people cluster and where they avoid.
Sketch map recordsWhich reveals
Doorways and thresholdsWho may enter, who waits outside
SeatingHierarchy, made physical
Where the worker standsWhether they face or turn from people
Where the queue formsWho is served first
Where children playWhat space they are given
Space encodes hierarchy in ways nobody would state aloud. Who sits on the mat and who sits on the chair is a caste and gender fact that no interview would surface as such.
Draw the map badly and quickly. A rough sketch with positions marked carries the finding; waiting until you can draw it properly means you will not draw it.
ImpactMojoObservation to Insight 101www.impactmojo.in
From broad to focused observation
Observation funnels over time: from descriptive (take in everything) to focused (track the dimensions that matter) to selective (count specific, well-defined behaviours).
01
DESCRIPTIVE: observe broadly, note all nine dimensions
02
FOCUSED: narrow to the emerging question
03
SELECTIVE: record specific, defined behaviours
PhaseYou areOutput
DescriptiveTaking in everythingBroad notes; the lay of the land
FocusedTracking the dimensions that matterNotes on selected aspects
SelectiveCounting defined behavioursTallies you can compare
The funnel is a sequence, not a choice. Starting at the selective phase means counting categories you assumed rather than discovered, which is how structured observation produces confident irrelevance.
Budget time for the descriptive phase explicitly. It looks unproductive — broad notes, no numbers — and it is what makes everything after it valid.
ImpactMojoObservation to Insight 101www.impactmojo.in
What you look for shapes what you find
A framework focuses attention — but a fixed framework can also blind you to what it leaves out. Hold your lens firmly enough to be systematic, loosely enough to be surprised.
Leave a column in your notes for 'things that don't fit my framework'. That column is often where the insight hides.
FrameworkHelps byBlinds by
Spradley’s nine dimensionsSystematic coverageNothing much — it is broad
A programme logframeFocusing on what you fundExcluding everything you do not
A checklist from another siteComparabilityImporting another place’s categories
Your own hypothesisEfficiencyConfirmation bias
The logframe row is the practitioner’s trap. Observing a programme against its own indicators finds out whether it did what it said, and never finds out what else is happening.
Keep a section of every session for what falls outside the framework. If it stays empty across many sessions, either the framework is very good or you have stopped looking.
ImpactMojoObservation to Insight 101www.impactmojo.in
04
Section Four
Field Notes
ImpactMojoObservation to Insight 101www.impactmojo.in
If it isn't written down, it didn't happen
Observation produces nothing without a record. Memory decays fast and reshapes itself to fit our expectations. Field notes are the raw data of observation — the single most important craft in this course.
Writing fieldnotes is not a record of what happened so much as a way of thinking about what happened.
— Emerson, Fretz & Shaw, Writing Ethnographic Fieldnotes
Time since observingWhat survives
DuringEverything — but you cannot write it all
Same dayMost detail, sequence, exact phrasing
Next dayThe outline; specifics gone
A week laterA story shaped to fit what you concluded
The last row is the danger and it does not feel like forgetting. Memory reconstructs coherently, so a week-old account feels vivid and reliable while having quietly organised itself around your interpretation.
Write up the same day, without exception. Fieldwork schedules that pack sessions back to back without writing time are producing worse data than fewer sessions would.
ImpactMojoObservation to Insight 101www.impactmojo.in
Jotted notes, then expanded notes
Jotted notes (in the field)
Quick scratch notes, key words, a sketch, an exact quote. Brief and unobtrusive — just enough to trigger memory later.
Expanded notes (after)
Written up the same day, while memory is fresh: the full scene, in order, with detail. The jottings are the seed; the expanded notes are the crop.
The golden rule of fieldnotes: write up the same day. One night's sleep erases more than you think.
Jotted notesExpanded notes
WhenIn the field, duringSame day, after
ContentKey words, quotes, a sketchFull scene-by-scene account
LengthA pageSeveral pages per hour observed
PurposeTrigger memoryThe actual data
Budget roughly an hour of writing per hour observed, more at the start. Fieldwork plans that ignore this arithmetic produce jottings nobody ever expands, which is to say no data at all.
Keep jottings unobtrusive. Visible sustained note-taking changes the behaviour you came to see, which is why the expansion happens afterwards rather than in the room.
ImpactMojoObservation to Insight 101www.impactmojo.in
Descriptive vs reflective notes
DescriptiveReflective / analytic
ContentWhat you saw and heardWhat you think it means
VoiceConcrete, low-inferenceInterpretive, questioning
Example'Worker weighed 6 children, recorded 4''Why were 2 not recorded?'
Keep themSeparate — in distinct columns or marksSeparate — so you can tell fact from hunch
Use a clear marker (e.g. [OC] for 'observer comment') so analytic asides never get mistaken for observed fact.
Note layerExample
Descriptive"Worker called three names; two mothers stood and moved forward"
Reflective"The two who moved were the ones she greeted by name"
Analytic"Possible pattern: familiarity determines order of service"
Personal"I found the waiting uncomfortable; noting in case it colours this"
Keeping the layers physically separate is what makes the analysis auditable. Mixed together, you cannot later tell what you saw from what you concluded — and neither can anyone reviewing your work.
Use two columns or two colours. The mechanism matters less than that it is consistent, because you will be reading these notes months later.
ImpactMojoObservation to Insight 101www.impactmojo.in
Describe before you interpret
High inference
'The mother was hostile and uncooperative.' — a judgement, already an interpretation, hard to verify.
Low inference
'The mother folded her arms, looked away, and answered in one word.' — observable detail anyone could have recorded.
Record the behaviour, not your label for it. Labels can be revised later; lost observations cannot be recovered.
High inferenceLow inference
"The mother was hostile""She folded her arms and did not reply for several seconds"
"The class was disengaged""Eleven of thirty had heads down; four were writing"
"The worker was dismissive""She answered without looking up from the register"
"The meeting was tense""Two people spoke; nobody responded to either"
The left column cannot be checked and the right column can. A reader who disagrees with your reading of the mother can still use your description; the judgement offers them nothing to work with.
You will still interpret — deciding to record the folded arms is already a choice. The discipline records the observable thing alongside the reading, rather than only the reading.
ImpactMojoObservation to Insight 101www.impactmojo.in
Thick description
Thick description
Clifford Geertz's term: an account that records not just an action but its context and meaning — the difference between a 'twitch' and a 'wink' lies in what it means to the people involved.
Thin: 'a man nodded.' Thick: 'when the upper-caste landlord entered, the labourer stopped speaking mid-sentence and nodded — a gesture of deference everyone present understood.' Thick description carries the meaning.
Thin descriptionThick description adds
"He winked"Whether it was a twitch, a signal, a parody
"They queued"Who joined where, who was let in, who left
"The meeting ended"Who left first, and what that meant there
Geertz’s point is about checkability, not richness. Thick description records enough context that a reader can assess whether your interpretation is right — it is a rigour standard, not a style.
If your write-up gives a reader no basis to disagree with your reading, it is not thick description. It is assertion with field notes attached.
ImpactMojoObservation to Insight 101www.impactmojo.in
Capture verbatim speech
When someone says something striking, write it down word for word, in their language, in quotation marks. A real quote is worth a paragraph of paraphrase — and it is honest evidence.
Mark verbatim quotes clearly. Mark your paraphrases too. Later you must know which words were theirs and which were yours.
Record verbatimBecause
In the speaker’s own languageThe wording carries the meaning
In quotation marksSo you know later it is exact
With who said it and whenContext decides the reading
Including the phrase you do not understandThose are often the important ones
The phrase you did not follow is the one worth writing down exactly. Local terms with no English equivalent — the word for a kind of obligation, or of shame — are frequently where the finding is.
Paraphrase silently translates the speaker into your categories. A real quote lets a reader hear them in theirs, and lets you notice later that they were not saying what you assumed.
ImpactMojoObservation to Insight 101www.impactmojo.in
Practical fieldnote discipline
  • Head every note: date, time, place, who was present
  • Write in the past tense, in order, scene by scene
  • Note what did not happen, and who was absent
  • Distinguish quotes, observations and your own thoughts
  • Number your pages; never tear any out
DisciplineWhat it prevents
Head every note: date, time, place, who was presentUnusable notes six months later
Write in sequence, scene by sceneA reconstruction organised by theme
Note what did not happenLosing the most-missed finding
Distinguish quotes from paraphraseAttributing your words to someone
Record who was absentMissing exclusion entirely
Writing in sequence rather than by theme is the one people abandon first, and it is what preserves the record. Notes organised by theme have already had the analysis applied to them.
The header takes ten seconds and makes the difference between a note you can use and a page of text you cannot place. Nothing else in this list has a better ratio.
ImpactMojoObservation to Insight 101www.impactmojo.in
Your field notebook is the instrument
In observation, there is no machine between you and the data — you are the instrument, and your notebook is its output. Treat it with the seriousness a surveyor gives a calibrated gauge.
Protect it. Back it up. A lost notebook is a lost dataset — and often weeks of irreplaceable fieldwork.
Treat the notebook asMeaning
The instrumentIts quality is your data quality
ConfidentialIt contains identifiable accounts
Backed upA lost notebook is lost fieldwork
Yours to keepNot handed to the programme you observed
Field notes are among the most identifying records in social research. A page describing who said what, in which village, on which day, cannot be anonymised after the fact.
Photograph or transcribe each day and store securely. The notebook is the only copy of everything you saw, and it travels in a bag through field conditions.
ImpactMojoObservation to Insight 101www.impactmojo.in
05
Section Five
Structured Observation Tools
ImpactMojoObservation to Insight 101www.impactmojo.in
When you need to count, not narrate
Once you know what matters, structured tools let you record it consistently — across observers, sites and time — so you can count, compare and track. Structure trades richness for reliability.
Structured tools answer 'how often / how many / how long'. Use them once unstructured observation has told you what to count.
Use structure whenNot when
You know what mattersYou are still finding out
You need to compare sitesYou need to understand one
Several observers are collectingOne observer, one setting
You will track change over timeThis is a one-off enquiry
Structure is what makes multiple observers and multiple sites poolable. Without it you have several people’s impressions, which cannot be added together however carefully each was recorded.
The prerequisite is knowing what to count, and that knowledge comes from unstructured work first. Building the checklist from assumptions is how you count the wrong things consistently.
ImpactMojoObservation to Insight 101www.impactmojo.in
Observation checklists
A checklist records whether defined things are present or absent: Is the growth chart displayed? Is the toilet functional? Is the teacher present? Simple, fast, and brutally clear.
Make each item observable and unambiguous. 'Toilet functional' must be defined — water present, door closes, not used for storage — so any observer marks it the same way.
Checklist itemGoodBad
Growth chart displayedPresent or absent — unambiguous
Toilet functionalNeeds a definition of functionalLeft to judgement
Teacher presentClear
Classroom is welcomingNot observable; not definable
Anything requiring a judgement call belongs on a rating scale with anchors, not a checklist. A yes/no item that two observers answer differently produces numbers that look comparable and are not.
"Functional" is the classic underspecified item. Water available? Door closes? Cleaned today? Each is checkable; "functional" collapses them into one observer’s opinion.
ImpactMojoObservation to Insight 101www.impactmojo.in
Rating scales
A rating scale records degree, not just presence: classroom engagement on a 1–5 scale, cleanliness from poor to excellent. Powerful, but only if every point is anchored with a description.
Unanchored scales invite disagreement. Define what a '3' looks like versus a '4', with concrete examples, or two observers will never agree.
Rating scale needsOr else
A descriptor for every pointObservers use the scale differently
Observable anchors, not adjectives"Good" means what the observer thinks
An even or odd choice made deliberatelyEveryone picks the middle
A pilot with two observersYou discover divergence in the analysis
Anchoring every point is the whole difference between a scale and a guess. "3 = moderate engagement" is not an anchor; "3 = roughly half the class following the activity" is.
Central tendency — everyone defaulting to the middle — is the commonest failure of unanchored scales, and it looks like consensus in the data.
ImpactMojoObservation to Insight 101www.impactmojo.in
Time sampling vs event sampling
Time samplingEvent sampling
RuleObserve at set intervals (every 5 min)Record every time an event occurs
CapturesWhat is typical / how prevalentHow often a specific event happens
Good forOngoing states (on-task, idle)Discrete events (a conflict, a sale)
MissesEvents between snapshotsNothing of that event — but ignores the rest
Time sampling = repeated snapshots. Event sampling = a trigger you watch for. Pick by whether you care about states or events.
Time samplingEvent sampling
RuleObserve at set intervalsRecord every occurrence
AnswersHow typical is this?How often, and in what sequence?
Good forContinuous states — on-task, presentDiscrete events — a rebuke, a referral
MissesAnything between snapshotsNothing, if you catch it all
CostLowHigh — continuous attention
Time sampling estimates prevalence; event sampling captures sequence. Using time sampling for rare events produces zeros that mean nothing, and it is the commonest misapplication of the method.
Interval choice is a real decision. Snapshots every five minutes in a forty-minute lesson give you eight observations, which is a small sample for a claim about the lesson.
ImpactMojoObservation to Insight 101www.impactmojo.in
A time-sampling tally in a classroom
Children on-task at 5-minute snapshots (one 40-min lesson)
ILLUSTRATIVE — invented tally to show the method
ILLUSTRATIVE. Snapshots every 5 minutes turn a vague impression ('attention drifted') into a countable, comparable pattern.
Time-sampling decisionConsequence
Interval lengthFive minutes over 40 gives eight data points
What counts as on-taskMust be defined before, not judged during
How many sessionsOne lesson is not the teacher
Eight snapshots is a small sample for a claim about a lesson, and a claim about a teacher needs many lessons. The precision of the tally is not the precision of the finding.
Report the interval, the definition and the number of sessions alongside any tally. Without those the number is uninterpretable, however carefully it was collected.
ImpactMojoObservation to Insight 101www.impactmojo.in
Observation guides
Between a free notebook and a rigid checklist sits the observation guide: a structured prompt list of things to attend to, with room for open description. It steers without straitjacketing.
A good guide is one page: the dimensions to cover, the key questions, and space to write what you did not expect.
InstrumentSteersAllows discovery
Free notebookNot at allFully
Observation guidePrompts what to attend toYes — open description
ChecklistFullyNo
The guide is the underused middle option. Most field observation needs steering without closure — a prompt list plus room to describe — and defaults to one of the extremes instead.
Write the guide as questions rather than categories. "Who is served first, and how is that decided?" prompts observation; "service order" prompts a one-word answer.
ImpactMojoObservation to Insight 101www.impactmojo.in
Operationalise every behaviour you count
A structured tool is only as good as its definitions. Before you can tally 'on-task' or 'aggressive interaction', you must write down exactly what counts — an observable rule any observer can apply the same way.
Too vague
'Child engaged' — engaged how? Two observers will count completely different things.
Operationalised
'Eyes on the teacher or task material, not talking off-topic' — observable, repeatable, countable.
BehaviourOperational definition
On-taskEyes or hands on the assigned material
Teacher presentIn the room, not the corridor
WaitingSeated or standing in the queue area, not yet served
Aggressive interactionRaised voice, or physical contact without consent
Write the definition before the fieldwork, and test it. A definition that seemed obvious in the office resolves ambiguously in the field roughly as often as not.
Include the edge cases in the definition: a child looking at another child’s book, a teacher visible through the door. Those are what two observers will disagree about.
ImpactMojoObservation to Insight 101www.impactmojo.in
Inter-observer agreement
Inter-observer agreement
The extent to which two or more observers, watching the same thing with the same tool, record the same result. A core test of whether a structured observation is reliable or just one person's impression.
Have two observers code the same session independently, then compare. Wide disagreement means your definitions are loose, not that one observer is 'wrong'. Tighten the tool and re-test.
Inter-observer agreementTells you
HighThe tool is defined well enough to be used
Low on one itemThat item’s definition needs work
Low overallThe instrument is not ready
Never measuredYou do not know whether your counts mean anything
The last row is the normal state of field checklists in development practice. Tools are designed, deployed and analysed without anyone ever checking that two observers using them agree.
Testing it is cheap: two observers, the same session, compare item by item. Doing it once during the pilot catches the items that would otherwise produce noise for the whole study.
ImpactMojoObservation to Insight 101www.impactmojo.in
Pilot every instrument
  • Test the checklist or scale in the real setting first
  • Watch where two observers diverge — fix those items
  • Check it can be completed in the time available
  • Refine definitions until the tool is boringly unambiguous
An untested observation tool is a guess. The pilot is where you turn it into an instrument.
Pilot revealsBefore it costs you
Items two observers read differentlyA whole study of noise
A tool too slow for the sessionHalf-completed forms
Definitions that fail at the edgesInconsistent counts
Categories that never occurWasted attention
Pilot in the real setting, not in the office. A checklist that works at a desk fails in a room with eighteen children, and you find that out either in the pilot or in the data.
The last row is worth acting on. A category that never occurred in the pilot is either rare enough to need event sampling or wrong, and either way it should not stay on the sheet.
ImpactMojoObservation to Insight 101www.impactmojo.in
06
Section Six
Sensemaking: Notes to Patterns
ImpactMojoObservation to Insight 101www.impactmojo.in
From a pile of notes to a pattern
After fieldwork you hold pages of notes, tallies and quotes. Sensemaking is the disciplined work of turning that pile into patterns, and patterns into insight. It is analysis, and it deserves as much rigour as the observing did.
01
NOTES: raw descriptions
02
CODES: label recurring things
03
THEMES: group codes into patterns
04
INSIGHT: what the patterns mean
You holdSensemaking turns it into
Pages of notesCodes
CodesPatterns that recur
PatternsThemes that answer the question
ThemesInsights with a "so what"
Each step discards material, deliberately. That is what makes it analysis rather than summary, and it is why the audit trail matters — a reader needs to see what was set aside and why.
Do not skip straight from notes to findings. The step people omit is coding, and without it the findings are whatever the analyst remembered most vividly.
ImpactMojoObservation to Insight 101www.impactmojo.in
Memo as you go
Memo
A short, dated note in which the observer thinks on paper — a hunch, a question, an emerging idea, a link between observations. Memos turn fleeting thoughts into a traceable trail of analysis.
Do not wait until the end to think. Write memos throughout fieldwork — the best ideas arrive in the field, then vanish.
Memo capturesWhich would otherwise
A hunchBe forgotten
A question the data raisedNot get answered because it was not recorded
A link between two sessionsHave to be rediscovered
A change of mindVanish from the audit trail
Memos are the first draft of your findings and the most-skipped step. Half a page written when an idea forms is worth more than a day of analysis three months later trying to recover it.
Date them and keep them with the notes. The sequence of memos is a substantial part of the audit trail — it shows how the interpretation developed rather than asserting where it landed.
ImpactMojoObservation to Insight 101www.impactmojo.in
Coding your observations
Coding means tagging stretches of notes with short labels — 'waiting', 'gatekeeping', 'workaround', 'deference' — so you can gather everything about each idea across all your notes.
01
READ: go through the notes closely
02
OPEN-CODE: name what you see, freely
03
GROUP: cluster similar codes
04
RECODE: refine into a stable set
CodeTags every instance of
waitingTime spent not being served
gatekeepingSomeone controlling access to a service
workaroundA rule circumvented to get the work done
deferenceBehaviour marking relative status
Codes let you gather one idea across all sessions, which is what turns twelve separate observations into a claim about a pattern rather than a set of anecdotes.
The workaround code is consistently the most productive in service-delivery observation. Where staff systematically break a rule to deliver, the rule is usually the finding.
ImpactMojoObservation to Insight 101www.impactmojo.in
Looking for recurring themes
A theme is a pattern that recurs across observations and carries meaning for your question. Themes are built, not found: you assemble them from repeated codes, then test whether they really hold.
Ask of any candidate theme: How often does it appear? Across how many sites and observers? Is there a clear example I can point to?
Is it a theme?Test
Does it recur across sessions?Not a one-off
Does it answer your question?Not just an interesting topic
Is it distinct from your other themes?Otherwise merge them
Can you show extracts supporting it?Including ones that complicate it
Themes are constructed, not found. Two competent analysts working the same notes will build different and equally defensible themes, which is why the audit trail matters more than the claim to objectivity.
The commonest failure is themes that mirror your observation guide. Six prompts producing six themes means the notes were sorted rather than analysed.
ImpactMojoObservation to Insight 101www.impactmojo.in
Hunt the case that doesn't fit
The instinct is to smooth over the observation that breaks your pattern. Resist it. The anomaly — the negative case — is where understanding deepens: it shows the limits of your pattern, or reveals a better one.
Actively search for disconfirming cases. A pattern that survives an honest hunt for exceptions is one you can trust.
Anomaly responseResult
Ignore itA tidy pattern that is partly false
Explain it awaySame, with more effort
State the condition it revealsA pattern with known limits
Revise the patternA better finding
The anomaly usually marks a condition you had not noticed. The one anganwadi where the queue works differently is telling you what the others depend on, which is more useful than the pattern alone.
Report it. A finding presented with the case that did not fit, and what you made of it, is far more credible than one presenting perfect consistency across a dozen sites.
ImpactMojoObservation to Insight 101www.impactmojo.in
Count where you can, carefully
Qualitative does not mean anti-number. Noting that a behaviour appeared in 9 of 12 observed sessions is honest and useful — far better than the vague word 'often', which lets readers imagine any figure they like.
Prefer 'in most sessions (9 of 12)' to 'frequently'. Modest counts make qualitative claims auditable.
SayNot
"In 9 of 12 observed sessions""Often"
"In every session we observed""Always"
"Twice, both in the same site""Sometimes"
"We did not observe this""This does not happen"
The last row is the important one. Not observing something in twelve sessions is weak evidence of absence, and phrasing it as absence is the most common over-claim in observational reporting.
Counting is honest as long as the denominator travels with it. "9 of 12 sessions" is a fact about your fieldwork; "75% of anganwadis" is a claim about a population you did not sample.
ImpactMojoObservation to Insight 101www.impactmojo.in
Know when you've seen enough
Saturation
The point at which further observation stops yielding new themes — you keep seeing what you have already seen. A practical signal that you have observed enough on a given question.
Saturation is a judgement, not a finish line. Reaching it on one theme does not mean you have it on another.
Saturation claimCredible when
"We reached saturation"Never, on its own
"The last three sessions produced no new codes"A stated stopping rule
"We observed three more to check"The judgement was tested
"Saturated for X, not for Y"Honest about scope
Saturation is specific to a question at a breadth, not a general property of the fieldwork. You can be saturated on how the queue works and nowhere near it on why some families never come.
It is also a stopping rule that budgets rarely permit. Where fieldwork length was fixed in advance, say so instead of claiming saturation you did not test.
ImpactMojoObservation to Insight 101www.impactmojo.in
Show your working
Rigour in qualitative analysis is about transparency. Keep an audit trail: your codes, the rule for each, example quotes, and how a theme was built. Another analyst should be able to follow your path from notes to claim.
If you cannot show how you got from your notebook to your conclusion, neither can your reader trust it.
Audit trail containsWritten
The codebook and each code’s ruleAs codes are created
Example extracts per codeAt the time
How each theme was builtIn memos, dated
Decisions that changedWhen they changed
Your reflexive journalAlongside field notes
Reconstructed afterwards, an audit trail is a justification rather than a record — and readers can usually tell, because it is too tidy about how the interpretation arrived.
The standard to aim for: another analyst could follow your notes and see how you got from observations to conclusions, even if they would have concluded something else.
ImpactMojoObservation to Insight 101www.impactmojo.in
07
Section Seven
Triangulation
ImpactMojoObservation to Insight 101www.impactmojo.in
No single method sees everything
Triangulation
Using more than one method, source or observer to study the same question, so that the strengths of each compensate for the blind spots of the others — borrowed from surveying, where two bearings fix a point.
Observation tells you what people do; interviews tell you what it means to them; documents and data tell you the scale. Together they triangulate the truth.
Triangulation typeVariesGuards against
MethodObservation, interview, recordsOne method’s blind spot
SourceDifferent people, sites, timesAn unrepresentative slice
ObserverDifferent people watchingOne person’s selective attention
TheoryDifferent interpretive lensesA single framing
Denzin distinguished these four and practitioners generally use only the first. Observer triangulation is the cheapest of the remaining three and almost never done.
Convergence from sources that share a bias is not convergence. Two observers from the same organisation with the same expectations will agree for reasons unrelated to what happened.
ImpactMojoObservation to Insight 101www.impactmojo.in
Three lines of sight on one question
OBSERVATIONwhat people doINTERVIEWSwhat it meansDOCUMENTS & DATAthe scalethe question
Denzin distinguished several kinds: of method, of source, of observer, and of theory. The principle is the same — one bearing is a guess; three fix a position.
ImpactMojoObservation to Insight 101www.impactmojo.in
Observation + interviews
Observe first, then ask. Seeing a practice lets you ask far sharper interview questions — about the very thing you watched — and lets you probe the gap between what you saw and what people say.
'I noticed the queue formed differently today — can you help me understand why?' Observation earns you questions no outsider could otherwise ask.
Observe first, then askLets you
Ask about the specific thing you watchedRather than in general
Probe the say–do gap directlyWithout accusation
Use their vocabularyLearned from watching
Notice what they do not mentionBecause you saw it
Sequencing matters more than most designs allow for. Interviewing first produces general accounts; interviewing after observing produces answers about a concrete event you both know happened.
Ask without implying deceit. "I noticed the queue formed differently on Tuesday — what was happening?" opens the topic; "you said everyone is served in order, but…" closes it.
ImpactMojoObservation to Insight 101www.impactmojo.in
Observation + documents and records
Registers, muster rolls, attendance sheets and meeting minutes are claims about reality. Observation tests them: does the attendance register match the children you counted in the room?
Where the record and the room disagree, you have not found an error — you have found a finding worth understanding.
Record claimsObservation tests
Attendance registerWho is actually present
Muster rollWho actually worked
Stock registerWhat is on the shelf
Meeting minutesWho spoke, and whether it was decided there
Registers are claims about reality, produced under incentives. Treating them as data rather than as claims is how monitoring systems come to describe a version of the programme that nobody is delivering.
A discrepancy is not necessarily fraud. Registers are often filled to satisfy a requirement that does not match the work — and that mismatch is itself the finding worth reporting.
ImpactMojoObservation to Insight 101www.impactmojo.in
Observation + quantitative data
Survey and administrative data tell you how widespread; observation tells you how and why. A dashboard shows immunisation coverage dipped; observation of the session shows the cold-chain box was empty.
Numbers raise the question; observation often answers it. Pair a surprising statistic with a visit to where it is produced.
Data saysObservation explains
Immunisation coverage dipped in Q3The session moved to a day women cannot attend
Dropout rises after Class 8The journey, not the school
Toilet coverage is 90%How many are used, and by whom
Scheme uptake is lowWhere the application actually stalls
Numbers locate the problem and observation identifies the mechanism, which is why a dashboard anomaly is the best possible prompt for a short, focused field visit.
The pairing works in both directions. Observation generating a hypothesis that survey data can then size is as valuable as observation explaining a number.
ImpactMojoObservation to Insight 101www.impactmojo.in
When sources agree: convergence
When observation, interviews and data all point the same way, your confidence rises sharply. Independent methods reaching the same conclusion are unlikely to be wrong in the same direction by chance.
Convergence is the strongest evidence a field study can offer: many bearings, one position.
Convergence is meaningful whenNot when
The methods are genuinely independentBoth drew on the same informants
They could have disagreedOne was designed to confirm the other
Different observers, different backgroundsThe same team, same expectations
The sources have different biasesThey share a bias
Agreement between sources that share a bias is one measurement reported twice. Independent error is what makes convergence informative, and independence has to be designed rather than assumed.
Ask what would have had to happen for the sources to disagree. If the answer is nothing plausible, their agreement carries no information.
ImpactMojoObservation to Insight 101www.impactmojo.in
When sources disagree: divergence
Disagreement is not failure — it is information. If the register says 30 and you counted 18, if women report ease of access but you observe them turned away, the divergence itself is the finding.
Do not paper over a conflict between sources. Investigate it: one source may be wrong, or each may be true of a different reality.
DivergencePossible readings
Register says 30, you counted 18Reporting pressure; or you came on an atypical day
Women report easy access; you saw refusalsFear of consequence; or you saw an exception
Staff describe a process nobody followsThe process is unworkable as written
Every row has at least two readings and only more evidence separates them. Treating divergence as proof that one source is lying is the failure mode; treating it as a question is the method.
Divergence is the most informative outcome of triangulation and the one most often left out of reports, because it is harder to write than agreement.
ImpactMojoObservation to Insight 101www.impactmojo.in
Triangulating across observers
Triangulation is not only across methods. Two observers watching the same setting — ideally differing in gender, language or background — will notice different things. Comparing their notes is itself a check on bias and a way to see more.
Where two observers agree, confidence rises. Where they differ, you learn how positionality shaped each view — both useful.
Observers differing inSee differently
GenderAccess to spaces; what people will say
LanguageWhat is heard at all
Caste or communityCandour about discrimination
Familiarity with the settingThe taken-for-granted
Pair observers deliberately rather than for convenience. Two people who differ on one of these axes will produce genuinely different notes on the same session, and the difference is data.
Compare notes before discussing interpretations. Once one observer has said what they thought it meant, the other’s independent record is contaminated.
ImpactMojoObservation to Insight 101www.impactmojo.in
Triangulation is a habit, not a checkbox
  • Plan from the start to look at each question more than one way
  • Record which method produced which claim
  • Treat agreement as confirmation, disagreement as a lead
  • Never let one striking observation stand entirely alone
HabitInstead of
Plan multiple lines of sight per questionAdding a method at the end
Record which method produced which claimA blended findings section
Treat disagreement as informationChoosing the source you trust
Report what you could not triangulateSilence about the gaps
Recording which method produced which claim is the cheapest of these and the most useful to a reader. It lets them weigh each finding by the method behind it rather than by your confidence.
Triangulation planned at design costs little; triangulation attempted at write-up is a request for data you did not collect.
ImpactMojoObservation to Insight 101www.impactmojo.in
08
Section Eight
From Insight to Action
ImpactMojoObservation to Insight 101www.impactmojo.in
The 'so what?' test
A pattern is not yet an insight, and an insight is not yet a decision. After every finding, ask the practitioner's question: so what? What should change because we now know this?
01
OBSERVATION: what we saw
02
PATTERN: what recurs
03
INSIGHT: what it means
04
ACTION: what we'll do differently
FindingSo what?
Attendance is lowNothing yet — this is a fact
Attendance is low on market daysMove the session
Women arrive and leave unservedThe queue rule, not the coverage
Staff work around the registerThe register is the problem
Ask "so what" of every finding before it goes in a report. A finding that survives the question points at a decision; one that does not is a description someone will read and forget.
The fourth row is the pattern worth looking for. Where competent staff systematically break a rule to get the work done, the rule is usually what needs changing.
ImpactMojoObservation to Insight 101www.impactmojo.in
What makes a finding an insight?
An insight is a finding that is actionable and non-obvious — it changes how you understand the problem, and it points somewhere. 'Attendance is low' is a fact; 'attendance collapses on ration-delivery days because mothers must queue elsewhere' is an insight.
Test: could someone act differently because of this? If not, keep digging — you have a fact, not yet an insight.
FactInsight
ExampleAttendance is lowMothers leave before the weighing because it runs after the meal
Actionable?NoYes
Non-obvious?NoYes
Changes understanding?NoYes
An insight must be both actionable and non-obvious. Findings that are actionable and obvious were already known; findings that are non-obvious and unactionable are interesting and change nothing.
Most observation reports are full of the first row. The move to the second requires the mechanism, which is exactly what observation is uniquely able to supply.
ImpactMojoObservation to Insight 101www.impactmojo.in
The observation-to-insight funnel
RAW OBSERVATIONS — everything seenCODED PATTERNS — what recursINSIGHTS — what it meansDECISIONS
The funnel narrows for a reason: many observations yield few decisions. The discipline is choosing which patterns are worth acting on.
ImpactMojoObservation to Insight 101www.impactmojo.in
Turn patterns into recommendations
A useful recommendation is specific, owned and feasible: who should do what, by when. 'Improve services' helps no one; 'shift the weighing session to avoid the ration-queue clash, with the supervisor confirming the new time' can be acted on tomorrow.
Tie every recommendation back to the observation that motivates it. Evidence-to-action should be traceable in one line.
RecommendationUsable?
"Improve services"No — no owner, no action
"Increase community awareness"No — the default non-recommendation
"Shift the weighing session to before the meal"Yes
"CDPO to reissue the session timing by June"Yes — owner and date
Specific, owned and feasible. A recommendation without a named actor is a wish, and reports full of them are why field studies are read once and filed.
Check feasibility with the person who would have to do it before writing it down. Recommendations that ignore what an anganwadi worker can actually decide discredit the rest of the report.
ImpactMojoObservation to Insight 101www.impactmojo.in
Close the loop with the field
Insight that never returns to the people who generated it is extraction. Share findings back with frontline workers and the community — both to respect them and to check your interpretation against theirs.
Member checking: showing your reading of events to the people you observed is both an ethical duty and a validity test.
Feeding backServes
Respect for people’s time and trustThe ethical obligation
Correction of your misreadingsThe findings’ accuracy
Local ownership of the fixWhether anything changes
Continued accessYour next visit
Feeding back is a validity check as well as a courtesy. Frontline workers reading your interpretation will tell you where you misread a routine, and that correction is unavailable any other way.
Feed back in a usable form — a meeting, a page in the local language — not a report in English. Research that never returns to the people who generated it is extraction with a method section.
ImpactMojoObservation to Insight 101www.impactmojo.in
Build observation into the system
The most powerful use of observation is not the one-off study but the feedback loop: routine, light-touch field observation that continuously corrects the programme — supervision visits that actually watch, and act.
01
OBSERVE in routine visits
02
FLAG gaps between protocol and practice
03
ADJUST the programme
04
OBSERVE again
One-off studyRoutine observation loop
Deep, expensive, occasionalLight, cheap, continuous
Findings arrive after decisionsCorrects while there is time
External observersSupervisors and frontline staff
A reportA habit
The loop is the higher-value use and the harder one to fund, because it produces no report and no attributable finding — only a programme that keeps adjusting.
Build it into supervision visits: a short structured guide, a fixed rhythm, and a route for what is seen to reach whoever can change it. Without that last part it is monitoring theatre.
ImpactMojoObservation to Insight 101www.impactmojo.in
Don't over-reach from what you saw
Observation at a handful of sites cannot, on its own, prove a statement about a whole district. State what your observation can carry — rich explanation, mechanism, hypotheses — and be honest about what it cannot.
The fastest way to lose credibility is to claim population-level certainty from a few vivid visits. Match the claim to the evidence.
Observation at a few sites can carryIt cannot carry
Rich explanation of a mechanismA claim about a district
A hypothesis worth testing at scaleA prevalence estimate
Evidence a practice existsEvidence of how common it is
Evidence a register is unreliable hereThat all registers are
State what your observation can carry, in the report, in a sentence. The over-reach is rarely deliberate — it happens in the summary, where careful findings get compressed into confident generalisations.
Pairing with survey data is the honest route to scale claims. Observation explains the mechanism; something else establishes how widespread it is.
ImpactMojoObservation to Insight 101www.impactmojo.in
Make the insight land
  • Lead with the insight and its 'so what?', not the methodology
  • Use one concrete observed example to make it vivid
  • Show the triangulation that backs it
  • Name the decision it implies, and who owns it
Lead withNot with
The insight and its "so what"The methodology
One vivid observed exampleA summary of the sample
The triangulation behind itAssertion
The decision you are asking forA list of findings
Methodology belongs in the annex and in the room if challenged. A report opening with sampling and instruments loses the reader who has to act on it before reaching what you found.
One concrete example does more than a paragraph of aggregate. The mother who leaves before the weighing is remembered; "growth monitoring completion is low" is not.
ImpactMojoObservation to Insight 101www.impactmojo.in
09
Section Nine
Bias & Rigour
ImpactMojoObservation to Insight 101www.impactmojo.in
The observer is part of the experiment
In observation there is no neutral camera. You select, perceive and interpret — and your presence changes the scene. Rigour is not the absence of bias; it is the disciplined management of it.
The honest question is not 'am I biased?' (you are) but 'which biases are at work here, and what am I doing about them?'
Source of biasDiscipline
You select what to recordA framework, and space for what falls outside
You perceive selectivelyMultiple observers
You interpretSeparate descriptive and reflective layers
Your presence changes the sceneProlonged engagement; name the effect
Rigour is not the absence of bias, it is its management and disclosure. An observational study claiming neutrality has misunderstood the method; one that names its observer’s position has not.
Each discipline here reduces one source and removes none. Reporting which you used, and which you could not, is what lets a reader weigh the findings appropriately.
ImpactMojoObservation to Insight 101www.impactmojo.in
The observer effect & the Hawthorne effect
Observer (Hawthorne) effect
People behave differently when they know they are being watched — named after the 1920s–30s Hawthorne Works studies, where worker output changed simply because attention was being paid.
Mitigate by spending enough time that your presence becomes ordinary, observing routine rather than special events, and being honest in reporting that you were there.
Observer effectWhat reduces it
Behaviour changes when watchedTime — performance is hard to sustain
Peaks on the first visitRepeat visits, unannounced where ethical
Stronger with a clipboard or cameraMinimal, unobtrusive recording
Cannot be eliminatedName it in the methods
The effect decays, which is the strongest practical argument for prolonged engagement. A single announced visit observes a performance; the fourth visit observes something much closer to routine.
The Hawthorne studies of the 1920s and 30s gave the effect its name and their original interpretation is now much disputed. The phenomenon is real; the founding evidence for it is weaker than the label suggests.
ImpactMojoObservation to Insight 101www.impactmojo.in
Selective attention
The eye cannot take in everything, so it filters — and the filter is shaped by what you expect and care about. The famous 'invisible gorilla' experiment showed observers can miss the obvious while counting something else.
Counter it with a framework that forces attention to dimensions you might skip — and with a second observer who notices what you do not.
Selective attention meansCounter
You see what you expectWrite expectations down beforehand
You miss the unexpected entirelyA second observer
Attention narrows under loadShorter sessions; structured prompts
You cannot notice what you missedThis is why it is dangerous
The invisible-gorilla studies showed people focused on a counting task failing to see something obvious in plain view. Field observation is exactly that task, sustained for an hour.
The last row is why individual effort cannot fix it. You have no access to what your attention filtered out, which makes a second observer the only real remedy.
ImpactMojoObservation to Insight 101www.impactmojo.in
Confirmation bias
Confirmation bias
The tendency to notice, record and weight what fits what you already believe, while overlooking what contradicts it — the single most dangerous bias in field observation.
The discipline of hunting for disconfirming cases (Section 6) exists precisely to fight this. If everything confirms your prior, suspect yourself, not the world.
Confirmation bias shows asCounter
Recording what fits, skipping what does notA quota for disconfirming observations
Weighting a confirming case more heavilyCount instances, do not weigh impressions
Asking questions that presume the answerHave someone else read your guide
Stopping once the pattern is clearKeep observing past the point of comfort
It is the most dangerous bias in observation because it feels like insight. The pattern becomes clearer with each session precisely because you are noticing the confirming instances more readily.
The practical counter is to write down, before fieldwork, what you expect to find — and then check your notes specifically for evidence against it.
ImpactMojoObservation to Insight 101www.impactmojo.in
Going native — losing the distance
Going native is the opposite risk to detachment: the observer so identifies with the group that they stop questioning, adopt its assumptions, and lose the outsider's vantage that made observation valuable.
The fieldworker's tightrope: close enough to understand, distant enough to see. Step off and write reflective notes regularly to keep your footing.
Too detachedGone native
SeesSurfaces onlyEverything, as an insider does
MissesMeaningWhat an insider stopped questioning
RiskMisreading behaviourAdopting the group’s assumptions
RemedyProlonged engagementPeer debriefing; time away
Both ends fail and the second is harder to notice from inside. Detachment feels like insufficiency; going native feels like understanding, which is why it needs an outside reader.
Schedule someone who was not there to read your notes periodically. They will ask the questions the setting has trained you to stop asking.
ImpactMojoObservation to Insight 101www.impactmojo.in
Reflexivity
Reflexivity
The practice of examining how you — your assumptions, reactions and presence — shape what you observe and conclude, and recording it openly as part of the data.
Keep a reflexive thread in your notes: What surprised me? What irritated me? What did I expect to see? Your reactions are evidence about both the setting and yourself.
Reflexive journal recordsWhich later
What you expected before going inLets you check what you found against it
Your reactions duringSeparates discomfort from evidence
How people responded to youExplains what you could and could not see
Changes in your own readingForms part of the audit trail
Keep it alongside field notes, dated, from the first day. Written at the end, reflexivity is recollection; written throughout, it is data about how the data was produced.
It is not confession and not self-indulgence. Its purpose is to let a reader judge which parts of your account your presence made accessible and which parts it foreclosed.
ImpactMojoObservation to Insight 101www.impactmojo.in
Positionality
Who you are — gender, caste, class, age, language, the agency you represent — shapes what people show you and what you are able to see. Positionality is naming that honestly.
A young male outsider and a local older woman will observe different versions of the same household. Neither is the truth; both must be named.
Your attributeOpensCloses
GenderSame-gender spacesThe other half of the setting
Caste or communityCandour withinFrankness across the line
LanguageNuance and indirectionEverything, if working through translation
The agency you representDoors and recordsComplaints about that agency
The last row is the practitioner’s specific problem. Observing a programme your own organisation funds means the people observed are managing an audit, whatever you tell them.
Say so in the methods. An observer from the funding agency will see a version of the setting, and a reader who knows that can interpret the findings; one who does not cannot.
ImpactMojoObservation to Insight 101www.impactmojo.in
How to make observation trustworthy
  • Prolonged engagement: enough time to see past the performance
  • Triangulation: multiple methods, sources and observers
  • Disconfirming cases: actively seek what breaks your pattern
  • Audit trail: show how you got from notes to claim
  • Member checking: test your reading with those observed
  • Reflexivity: name your own influence on the data
TechniqueAddresses
Prolonged engagementObserver effect; first impressions
TriangulationOne method’s blind spot
Disconfirming casesConfirmation bias
Low-inference notesInterpretation posing as description
Audit trailWhether anyone can check you
Peer debriefingYour own blind spots
None of these makes observation objective and together they make it checkable, which is the achievable standard. Reporting which you used is part of the finding.
Peer debriefing is the cheapest and least used: a colleague who was not there reading your notes and arguing with your reading catches what prolonged immersion has made invisible to you.
ImpactMojoObservation to Insight 101www.impactmojo.in
10
Section Ten
Ethics of Observation
ImpactMojoObservation to Insight 101www.impactmojo.in
You are watching real people's lives
Observation enters people's spaces, routines and vulnerabilities — often without them gaining anything. Ethics is not a clearance form at the end; it is a duty that runs through every minute in the field.
The privilege of observing someone's life carries the obligation to protect it.
— a principle of field research ethics
Ethics isNot
A design decision, before fieldworkA clearance form at the end
Continuous during observationSettled by initial consent
About what you write, tooOnly about how you watch
Weighed with the communityDecided on their behalf
Observation enters people’s routines and vulnerabilities, often with nothing flowing back. That asymmetry is the starting point, and it does not dissolve because a form was signed.
The third row is the one people forget. A carefully consented observation written up in a way that identifies someone in a small village has caused the harm regardless of the process.
ImpactMojoObservation to Insight 101www.impactmojo.in
Informed consent in observation
People should know who you are, that you are observing, why, what you will do with what you record, and that they may decline — in a language and form they truly understand. Consent is harder in observation, because settings are fluid and people come and go.
Gain consent from gatekeepers and the people themselves. A headmaster's permission is not a child's consent.
Consent means they knowAnd
Who you areWhich organisation, and why that matters
That you are observingNot visiting
What you will recordAnd what you will not
Where it will goReport, funder, publication
That they may declineWithout any cost to them
The last line is what makes it consent. Permission given to someone who controls a service the person needs is compliance, and everyone in the room understands that even when nobody says it.
Consent in observation is also continuous. People arrive and leave, and someone who joins an hour in has not agreed to anything — which is a real, unresolved difficulty in group settings.
ImpactMojoObservation to Insight 101www.impactmojo.in
Privacy in public and private space
SettingExpectationYour duty
Open public space (market, road)Low privacyObserve, but don't single out individuals
Semi-public (clinic, school)MixedSeek institutional and individual consent
Private (home, ritual, body)High privacyExplicit consent; many things stay unrecorded
'It happened in public' does not make everything fair to record. Sensitive acts in public spaces still deserve discretion.
SettingPrivacy expectationYour duty
Open public spaceLowObserve; do not single people out
Semi-public — clinic, schoolModerateInstitutional permission and individual consent
Private — a homeHighExplicit consent from those present
Online spacesContestedDo not assume public means fair game
Semi-public settings are where most development observation happens and where the rules are least clear. Permission from the block officer is not consent from the woman in the queue.
Get both. Institutional permission gets you through the door; individual consent is what makes observing a specific person’s interaction defensible.
ImpactMojoObservation to Insight 101www.impactmojo.in
Photography & recording
A camera or recorder raises the stakes sharply: images and audio are identifiable, permanent and easily shared. They need their own, explicit consent — separate from consent to be observed.
  • Never photograph children or sensitive scenes without specific consent
  • Explain where images will appear and for how long
  • Allow people to say yes to observation but no to the camera
  • Store and transmit recordings securely
Recording deviceRaisesRequires
CameraPermanent, identifiable, shareable imagesSeparate explicit consent
AudioVerbatim, attributable speechSeparate consent; secure storage
Phone in handSuspicion, whether or not you recordExplaining what you are doing
Any of theseChanged behaviourNaming the effect in your notes
Consent to be observed is not consent to be photographed, and neither is consent to publication. Treating the three as one is the commonest ethical failure in field visual work.
India’s DPDP Act, 2023 applies to identifiable personal data held digitally, images included. Decide storage, retention and deletion before fieldwork rather than afterwards.
ImpactMojoObservation to Insight 101www.impactmojo.in
Power and vulnerability
The observer usually holds more power than the observed — literacy, institutional backing, the ability to leave. In settings of poverty, caste or gender hierarchy, a 'request' from an outsider can feel impossible to refuse.
Make refusal genuinely costless. Watch for consent given only because saying no felt unsafe — that is not real consent.
Power asymmetryEffect on consent
You represent the funding agencyRefusal feels risky
You arrived with an officialRefusal is refusing them
Literacy and language gapThe form is not understood
You can leave; they cannotThe consequences are unequal
A "request" from someone with institutional backing is heard as an instruction. That is not a failure of communication — it is an accurate reading of the situation by the person being asked.
Ask separately from the official who brought you, in the person’s own language, and make declining visibly costless. If nobody ever declines across a whole study, consent was not real.
ImpactMojoObservation to Insight 101www.impactmojo.in
Do no harm — including by what you reveal
  • What you write could expose someone to retaliation if read by the wrong person
  • Disguise identities; aggregate; remove tell-tale details in small communities
  • Some things you observe should never be published — judgement, not rules
  • If you witness serious harm, your duty of care may override your role as observer
Anonymity in a small village is hard: 'the only widow with a disabled son' identifies a person. Protect with care, not just labels.
Risk in what you writeMitigation
Identifying an individual in a small placeCoarsen detail; combinations identify
Exposing a staff member’s workaroundAggregate; do not name the site
Recording a disclosure of harmKnow your referral duty before you go
Notes read by the wrong personStore securely; codes not names
A description with village, gender, age and role attached identifies someone precisely, even with no name. Combinations of attributes are the usual route to re-identification in small communities.
The workaround problem is real: reporting that staff bypass a rule to deliver can get them disciplined. Report the pattern and the rule, not the person or the site.
ImpactMojoObservation to Insight 101www.impactmojo.in
The high bar for covert observation
Covert observation denies people the chance to consent. It can only be contemplated when the knowledge is important, no other method is possible, and harm is minimal — and even then it needs formal ethics approval. In most development work it is neither necessary nor defensible.
If you find yourself hiding why you are there, stop and ask whether the study should happen at all.
Covert observation requires all ofRarely met
The knowledge matters substantiallySometimes
No other method could obtain itRarely
Harm to those observed is minimalDepends entirely
Independent ethics approvalAlmost never granted
All four must hold, which is why the bar is effectively prohibitive in development practice. The second is where most proposed covert work fails: prolonged overt engagement would have worked.
Mystery-client studies of service delivery are the main legitimate case, and even there the observed staff are the ones bearing the risk of what you find.
ImpactMojoObservation to Insight 101www.impactmojo.in
Give something back
People give you their time, their space and their trust. Ethical observation asks what flows back: findings shared in usable form, recommendations that improve the service they use, respect for their time and their account of their own lives.
The test of ethical fieldwork: would the people you observed feel fairly treated if they read everything you wrote about them?
Give backIn a form that
Findings to frontline staffThey can act on, before the report is final
Findings to the communityIs in their language and not a PDF
Recommendations to those who decideNames the owner and the date
Anything promisedWas actually promised, and delivered
The last row is the one that damages trust for everyone who comes after. A community that has been observed repeatedly with nothing returning treats the next observer accordingly, and is right to.
Reciprocity needs a budget line and a date. Feeding back that depends on someone finding time after the report is submitted does not happen.
ImpactMojoObservation to Insight 101www.impactmojo.in
11
Section Eleven
Practice & Tools
ImpactMojoObservation to Insight 101www.impactmojo.in
Planning an observation
DecideBefore you go
QuestionWhat exactly am I trying to learn?
TypeParticipant or not? Structured or not? Overt (yes)
Site & timingWhere, when, and for how long?
ToolNotebook, guide, checklist — prepared and piloted
ConsentWhose permission, and how I'll ask
RecordingHow I'll capture and protect what I see
An hour of planning saves a wasted day in the field. Walk in knowing your question and your method.
Decide before you goOr you will decide it by default
The exact questionAnd record whatever catches your eye
Participant or not; structured or notDrift into detached and semi-structured
Site, timing, durationObserve when it was convenient
Consent process and who grants itRely on whoever let you in
What you will do with a disclosureImprovise, badly
Timing is a sampling decision disguised as logistics. Observing an anganwadi at 11 a.m. on a Tuesday tells you about 11 a.m. on Tuesdays, and most studies never say so.
Observe at more than one time of day and more than one day of the week if you intend any claim about what is typical. Otherwise report the slice you saw as the slice you saw.
ImpactMojoObservation to Insight 101www.impactmojo.in
A simple field-note template
  • Header: date, time, place, observer, who was present
  • Sketch map: the space and where people were
  • Descriptive column: what happened, in order, low-inference
  • Reflective column [OC]: your questions and hunches, kept separate
  • Verbatim quotes: striking words, in quotation marks
  • Follow-ups: what to check or ask next time
Template sectionPurpose
Header: date, time, place, observer, presentMakes the note usable later
Sketch mapSpatial patterns words cannot carry
Descriptive columnLow-inference, in sequence
Reflective columnWhat you think it means
Questions raisedFeeds the next session
The last row turns a set of visits into a study. Questions carried forward are what make session four sharper than session one, rather than four independent observations.
Keep the template on one page and use it every time. A format that changes between sessions cannot be compared across them, which is most of what you gain from having one.
ImpactMojoObservation to Insight 101www.impactmojo.in
Tools for capturing and analysing
ToolGood forNote
Paper notebookAlways-works field jottingsUnbeatable; no battery, low intrusion
Voice memosDictating expanded notes en route homeTranscribe the same day
KoboToolbox / ODKStructured checklists on a phone, offlineFree; great for counts & ratings
Notes app / ObsidianTyping up and linking expanded notesSearchable; back it up
Taguette / spreadsheetCoding notes & tagging themesFree; enough for most studies
Tools serve the method, never replace it. A disciplined notebook beats a fancy app used carelessly.
ToolGood forWatch for
Paper notebookJottings; no battery, low intrusionNothing — still unbeatable
Voice memoExpanding notes on the journey backTranscription time; storage security
Phone cameraSketch maps, layouts, documentsConsent; it changes behaviour
Coding softwareOrganising notes across sessionsIt does not analyse for you
Dictating expanded notes on the journey home is the single most effective practical habit in this deck. It captures detail while it is fresh and uses time that is otherwise lost.
For a study of a dozen sessions, a spreadsheet with a column per code is entirely adequate. Coding software is for corpus size and team coding, not for rigour.
ImpactMojoObservation to Insight 101www.impactmojo.in
Common mistakes to avoid
  • Writing up notes 'later' — later never comes; memory rots
  • Recording judgements instead of observable detail
  • Forgetting the camera and notebook also alter behaviour
  • Over-claiming from a few vivid visits
  • Skipping consent because the setting felt 'public'
MistakeConsequence
Writing up "later"Memory reorganises around your conclusion
Recording judgements not detailNothing a reader can check
Forgetting the notebook alters behaviourMistaking performance for routine
Over-claiming from a few sitesA finding that will not survive scrutiny
Never checking observer agreementCounts that mean nothing
The first is the one everyone commits and nobody notices. Notes written three days on feel vivid and detailed, and have quietly organised themselves around what you decided the visit meant.
Every item here is prevented by a habit rather than a technique. That is what makes observation a craft: the methods are simple and the discipline is what is scarce.
ImpactMojoObservation to Insight 101www.impactmojo.in
A short, honest reading list
  • Participant Observation — James P. Spradley (the nine dimensions, grand-tour)
  • Writing Ethnographic Fieldnotes — Emerson, Fretz & Shaw
  • The Interpretation of Cultures — Clifford Geertz ('thick description')
  • Qualitative Data Analysis — Miles, Huberman & Saldaña (coding, display)
  • Reflections on Fieldwork & field-methods guides from IDS and PRA traditions
Pair this deck with ImpactMojo's Qualitative Methods, Research Ethics and Data Literacy 101 courses.
ReadFor
Spradley, Participant ObservationThe nine dimensions and the grand tour
Emerson, Fretz & Shaw, Writing Ethnographic FieldnotesThe craft of notes — the most practical item here
Geertz, The Interpretation of CulturesThick description, in the original
Gold (1958) on observer rolesThe participant–observer continuum
Start with Emerson, Fretz and Shaw if you are going to the field this month. It is about the act of writing notes, which is the skill that decides whether anything else in this deck matters.
Spradley is the reference to keep open during a first study. The nine dimensions work as a checklist you can run through in the field, which is unusual for a methods text.
ImpactMojoObservation to Insight 101www.impactmojo.in
If you remember five things
  • Watch what people do — the say–do gap is the finding
  • Use a framework — Spradley's nine dimensions focus the eye
  • Write it up the same day — the notebook is your instrument
  • Triangulate — one bearing is a guess; three fix a position
  • Observe ethically — behind every observation is a person
TakeawayThe failure it prevents
Watch what people doTaking self-report as behaviour
Use a frameworkRecording whatever caught your eye
Write up the same dayA reconstruction shaped to your conclusion
Describe before interpretingA record nobody can check
TriangulateTrusting one method’s blind spot
The third is the habit that decides whether the rest matter. Everything else in this deck operates on the notes, and notes written from three-day-old memory are already a version of the interpretation.
If you take one item to the field, take the say–do gap. It is the reason observation earns its place among methods and the thing no survey will ever tell you.
ImpactMojoObservation to Insight 101www.impactmojo.in
Observation to Insight 101 · Complete
Now go and
watch closely.
CC BY-NC-ND 4.0·Free Forever·ImpactMojo 101 Series