| Survey | Qualitative | Administrative | |
|---|---|---|---|
| Answers | How many, how much | Why, how, meaning | What the system records |
| Strength | Generalisable, comparable | Depth, context, mechanism | Cheap, continuous |
| Sample | Representative sample | Small, purposive | Everyone served |
| Cost | High — fieldwork | Moderate | Already collected |
| Blind spot | Misses the 'why' | Cannot generalise | Misses who is not served |
| Constraint | Pushes toward | Watch-out |
|---|---|---|
| Tight budget | Shorter instrument, phone mode | Coverage & quality loss |
| Short timeline | Smaller sample, fewer items | Underpowered estimates |
| Few trained staff | Simpler skips, CAPI logic | Enumerator error |
| Remote terrain | Cluster sampling, offline tools | Travel cost & fatigue |
| Representation (wrong people) | Measurement (wrong answers) | |
|---|---|---|
| Coverage | Frame misses part of the population | — |
| Sampling | Chance variation in who is drawn | — |
| Non-response | Those who answer differ from those who don't | — |
| Validity | — | Question doesn't capture the concept |
| Response | — | Recall, social desirability, bad wording |
| Processing | — | Data entry & coding mistakes |
| Vague | Anchored | Why it's better |
|---|---|---|
| “Do you usually…?” | “In the last 7 days…?” | Defines 'usually' for everyone |
| “recently” | “in the last 30 days” | Same window for all respondents |
| “your income” | “income last month” | Fixes the unit of time |
| “often sick” | “ill in the past 2 weeks” | Countable, comparable |
| Open-ended | Closed-ended | |
|---|---|---|
| Answer | In their own words | Pick from fixed options |
| Best for | Exploring, unknown answers | Counting, comparing |
| Analysis | Slow — needs coding | Fast — ready to tabulate |
| Risk | Vague, hard to compare | Misses the unlisted answer |
| Use when | Few cases, discovery | Most quantitative items |
| Choice | Pro | Con |
|---|---|---|
| 5 points | Simple, fast, fits small screens | Less fine-grained |
| 7 points | More discrimination | Harder to read aloud |
| With midpoint | Allows a genuine neutral | Some hide there to avoid choosing |
| Forced (no midpoint) | Pushes a stance | Fabricates an opinion that isn't there |
| Method | How | Use when |
|---|---|---|
| Simple random | Every unit equal chance | You have a full list |
| Systematic | Every k-th unit from a list | Ordered list, no hidden cycle |
| Stratified | Split into groups, sample each | Must represent subgroups |
| Cluster | Sample whole groups (villages) | People geographically spread |
| Multistage | Clusters, then units within | Large national surveys (NFHS) |
| If you want… | You need… | Note |
|---|---|---|
| Tighter margin of error | A larger sample | ±3% needs ~3× the n of ±5% |
| Estimates for subgroups | More per subgroup | Each cell needs its own n |
| To detect a small change | More power | Effect size drives this |
| Cluster (not random) design | An inflation factor | The 'design effect' |
| Mode | Cost | Coverage | Length | Best for |
|---|---|---|---|---|
| Face-to-face / CAPI | High | Broadest | Long | Rigorous, rural, complex |
| Phone / IVR | Low | Phone owners | Short | Speed, crises, monitoring |
| Web | Lowest | Connected only | Medium | Staff & literate audiences |
| Self-completion | Medium | Literate | Medium | Sensitive topics |
| Tool | Good for | Note |
|---|---|---|
| KoboToolbox | Humanitarian & NGO CAPI | Free, offline, widely used |
| ODK (Open Data Kit) | Open-source mobile collection | Free, flexible, technical |
| SurveyCTO | Rigorous research surveys | Paid; strong quality controls |
| Survey Solutions | Large official surveys | Free (World Bank) |