How to Report Missing Data in a Market Survey

Author

Market Survey Analysis

Published

31st December 1969

Category

How to Report Missing Data in a Market Survey

Missing answers are part of the evidence. Report where they occur, what they may change and how the analysis handles them.

Market Survey Analysis insight: How to Report Missing Data in a Market Survey should be treated as a decision and evidence question before it becomes a market conclusion. Define the boundary first, then test what the research can support. For a wider market intelligence workflow, keep the evidence and the decision in the same review record.

Classify the missingness

A blank may mean a respondent skipped, a question did not apply, a routing rule removed the question or a process failed. These cases should not be silently combined because they carry different meanings.

Show where it occurs

Report missing answers by question, wave, mode and material subgroup where the decision requires it. A small overall rate can hide a large gap in the exact group used for the recommendation.

Do not make a default answer

Treating a blank as no, zero or the midpoint changes the measure. If an imputation or recode is appropriate, state the rule, inputs and sensitivity of the result to that choice.

Compare complete and incomplete cases

Where auxiliary information exists, compare respondents who completed the measure with those who did not. The comparison cannot prove the missing value, but it can show a risk that deserves narrower claims or follow-up.

Write the decision impact

A methods appendix should be honest, but the decision owner also needs the consequence. Say whether the recommendation changes under a reasonable alternative treatment and what evidence would resolve the uncertainty.

What the research team should record

RecordWhy it mattersReview question
Population and unitSets the boundary of the claimWho or what does the result describe?
Fieldwork and sourceShows how observations entered the studyWho could be included, excluded or missed?
Measure and analysisConnects the number to the decisionWould a different definition change the call?
Limitation and triggerPrevents false certaintyWhat evidence would change the recommendation?

From evidence to a decision

A market survey is strongest when a reader can follow the chain from decision to question, from question to sample, and from sample to interpretation. The chain should name the target population, field period, mode, achieved base, important exclusions and uncertainty convention. It should also identify what the survey cannot observe. The purpose is not to make research sound cautious for its own sake. It is to prevent a clean percentage from doing more work than its design supports.

A practical review checklist

Before release, ask whether another analyst can identify the population without guessing from the headline; whether the route into the study and the missing groups are visible; whether the calculation uses the right denominator; and whether the recommendation is narrower than the evidence rather than broader. Keep the question wording, code, source ledger, calculation and reviewer note together. That audit trail is what lets a team update the work without quietly changing the claim.

When sources disagree

Disagreement between a survey, an administrative series and an interview set is not a reason to pick the most convenient result. First check whether the sources describe the same population, unit, time period and definition. Then inspect coverage, recall, incentives, revisions and the possibility that the measures capture different stages of the market. A survey may record stated consideration while a transaction file records completed purchases. Both can be accurate and still point in different directions. Write the difference as a question for the decision owner, identify which source is fit for the immediate call, and assign the measurement that would reduce the remaining uncertainty.

Keep reporting proportional

A market report earns trust when the strength of its language matches the strength of its design. Use estimate, signal, indication or hypothesis when the evidence is directional or the boundary is narrow. Reserve stronger language for a result that survives the relevant checks on sampling, measurement, missingness, timing and competing explanations. Proportion does not mean timid writing. It means giving a clear recommendation while showing the condition that could change it. Decision owners need that condition because markets move, source definitions are revised and a result can travel into a segment or geography that the original study never covered.

Plan the next review

Every important finding should have an owner, a review date and a trigger. The trigger may be a new official release, a change in price or policy, a sample-quality warning, a product launch, a material shift in response or a result that crosses the decision threshold. Store the trigger beside the source and method record. This turns a static article into a maintained piece of market intelligence. When the review arrives, check the links, definitions, calculations and conclusion together. Updating a number without updating the caveat is how an accurate old claim becomes a misleading new one.

Frequently asked questions

What should appear beside a market survey result?

State the population, field period, measure definition, base, mode and uncertainty treatment. Add the relevant limitation when it changes how the result should be used.

Is a larger sample always better?

A larger sample can reduce some sampling variability. It does not automatically repair coverage, wording, nonresponse, measurement error or a weak decision question.

How should a limitation be handled?

Narrow the claim, show the limitation near the result and assign the next measurement. A provisional decision with a trigger is stronger than false certainty.

Can survey evidence forecast revenue?

Not on its own. Connect stated responses to observed behaviour, market size, access, price, competition and a stated model before calling the output a forecast.

Where can readers check the method?

Use the linked primary and methodological sources below, then retain the questionnaire, source ledger and analysis notes with the published work.

Sources

Research should be useful to a decision owner and fair to the people whose answers create the evidence. Keep the claim proportionate to the design.