03 · What You Need to Know
What Makes a Missing Outcome a Meaningful Gap?
First, What Do We Mean by an Outcome?
An outcome is a result, consequence, condition, behavior, or other endpoint that a study seeks to observe or measure. What counts as an outcome depends on the research question and discipline.
Suppose researchers evaluate a new teaching approach. Possible outcomes might include examination performance, knowledge retention, engagement, attendance, self-efficacy, course completion, or students' experiences. These outcomes concern the same intervention, but they answer different questions about what the intervention may accomplish or affect.
This distinction matters because evidence about one outcome does not automatically answer questions about another. Knowing that an intervention improves short-term performance, for example, does not establish that the improvement persists, increases engagement, reduces dropout, or produces other desirable consequences.
A Literature Can Be Crowded but Outcome-Incomplete
Research gaps are sometimes imagined as completely empty spaces in the literature. That is too restrictive. AHRQ-supported work on identifying research gaps from systematic reviews uses Population, Intervention, Comparison, Outcomes, and Setting, or PICOS, to characterize parts of research questions that existing evidence inadequately addresses. In other words, the outcome itself can be the location of a gap.
This means that a well-studied topic can still contain an important unanswered question. The relevant issue is not simply how many studies exist. It is whether those studies provide the evidence needed to answer the particular question you want to investigate.
Topic gap
The broader phenomenon or relationship has received little or no research attention.
Outcome gap
The broader phenomenon has been studied, but an important result or consequence remains inadequately examined.
The Outcome Must Matter, Not Merely Be Missing
This is the crucial test. You can usually find something that previous researchers did not measure. That alone does not make it worth studying.
Imagine that 40 studies have evaluated an intervention using several outcomes. You notice that none measured a variable that happens to be available in your survey instrument. Technically, you have found something missing. You have not yet demonstrated a meaningful research gap.
A stronger argument explains why the missing outcome changes what researchers, practitioners, policymakers, participants, or other relevant stakeholders can understand or decide. The outcome might capture an important benefit, an overlooked harm, a consequence valued by participants, or a dimension needed to judge whether an intervention actually achieves its intended purpose.
This is similar to the distinction between counting how many studies exist and establishing what evidence is actually needed. Research justification rests on the informational value of the missing evidence, not merely its scarcity.
Ask What We Cannot Conclude Because the Outcome Is Missing
One useful way to evaluate an outcome gap is to complete this sentence:
Because existing studies do not adequately examine [outcome], we still cannot determine [important unanswered question or decision].
If the second half of that sentence is difficult to articulate, the proposed gap may be weak.
For example, saying that "few studies have measured academic confidence" identifies an absence. Saying that "existing evaluations focus on academic performance, leaving uncertainty about whether the intervention also affects students' confidence in performing the learning tasks independently" explains why the missing outcome changes our understanding.
Missing Outcomes Can Concern Benefits, Harms, Experiences, or Consequences
An outcome gap does not have to involve the primary intended effect of an intervention. Sometimes the literature answers "Does it work?" reasonably well but leaves other consequential questions unresolved.
| What the literature emphasizes |
Potential missing outcome |
What remains uncertain |
| Academic performance |
Student engagement |
Whether improved performance is accompanied by greater participation or involvement |
| Employee productivity |
Employee well-being |
Whether productivity gains have consequences for workers' well-being |
| Intervention effectiveness |
Adverse effects |
Whether benefits are accompanied by important harms |
| Immediate learning |
Knowledge retention |
Whether learning persists beyond the initial assessment |
| Service utilization |
User experience |
How people experience the service despite observable patterns of use |
Some of these apparent outcome gaps may overlap with other kinds of gaps. For instance, knowledge retention measured several months later may actually raise a missing time point or follow-up question. Likewise, an outcome available for the overall sample but not examined for a consequential subgroup may be better characterized as a missing subgroup problem. The categories are useful for thinking, but real research questions do not always stay politely inside one box.
Missing, Poorly Measured, and Selectively Reported Outcomes Are Different Problems
Before declaring an outcome gap, determine what is actually missing. At least three situations can look similar when you read published articles.
| Situation |
What is happening |
What the research problem may be |
| Outcome not studied |
Existing studies do not appear to investigate the outcome |
A possible missing-outcome gap |
| Outcome studied inadequately |
The outcome is included, but existing measures or designs provide weak evidence |
A measurement or methodological gap may be more accurate |
| Outcome measured but not reported |
Researchers collected the outcome but the published report does not provide the result |
A reporting problem rather than straightforward absence of research |
The third possibility deserves particular caution. Cochrane describes non-reporting bias as a problem that can arise when decisions about whether or how results are reported depend on their magnitude, direction, or statistical significance. Therefore, an outcome missing from published articles is not necessarily an outcome that researchers never measured.
Watch Out
Do not equate "I could not find this outcome in the published results" with "this outcome has never been studied." Protocols, trial registrations, supplementary materials, dissertations, reports, or other sources may reveal that the outcome was measured but incompletely reported.
Outcome Heterogeneity Can Also Make Evidence Difficult to Use
Sometimes the problem is not complete absence. Different studies may measure related outcomes in inconsistent ways, making comparison or synthesis difficult. In some fields, particularly health research, this problem has motivated the development of core outcome sets.
The COMET Initiative defines a core outcome set as an agreed standardized set of outcomes that should be measured and reported, at minimum, in trials within a specific area. The purpose is not to prohibit researchers from examining additional outcomes. Rather, using agreed core outcomes can make studies easier to compare and combine while helping ensure that important outcomes are not repeatedly overlooked.
Where a relevant core outcome set, reporting guideline, disciplinary framework, stakeholder consensus, or established theoretical model exists, it can provide stronger justification for why a particular outcome matters. Its existence does not automatically establish a gap, however. You still need to examine the actual evidence base.
A Missing Outcome May Reveal That the Literature Is Answering Only Part of the Question
Outcome gaps can be particularly consequential when a literature repeatedly privileges one kind of result. A body of studies may emphasize easily measured outcomes while giving less attention to outcomes that are harder to capture but important to stakeholders.
For example, studies of educational interventions may favor achievement measures because they are readily quantified, while students' experiences, accessibility, equity-related consequences, or sustained learning receive less attention. In another field, studies might emphasize efficacy while giving insufficient attention to harms or implementation consequences.
The gap, then, is not simply "Variable X has not been measured." The more substantive concern is that the current evidence provides an incomplete account of the phenomenon.
How Do You Establish That the Outcome Is Really Missing?
A defensible claim requires more than finding no results in your first database search. Search using alternative terminology for the outcome, because different disciplines and research traditions may use different labels for similar constructs. Examine recent reviews when available, then trace relevant primary studies. Check how outcomes were defined and measured rather than relying only on titles or abstracts.
If you are making a strong gap claim, also consider whether the outcome appears in study protocols, registrations, supplementary materials, or other reports. This helps distinguish genuinely absent evidence from incomplete reporting.
Your wording should reflect the strength and scope of what you actually found. A bounded statement such as "the reviewed studies predominantly evaluated short-term performance outcomes, while evidence concerning student well-being was limited" is usually more defensible than claiming that no researcher has ever examined the outcome. The same caution applies whenever you are tempted to say "no one has studied this before".
07 · A Quick Checklist
Before Claiming a Missing Outcome as Your Research Gap
Before writing the gap statement, check:
Define the outcome clearly and distinguish it from closely related constructs.
Search for alternative terms researchers may use for the same or similar outcome.
Establish what outcomes the existing literature actually emphasizes.
Determine whether the outcome is truly absent, merely uncommon, poorly measured, or incompletely reported.
Explain why the outcome is theoretically, practically, clinically, educationally, socially, or otherwise consequential to your research question.
Identify the specific conclusion or decision that current evidence cannot adequately support because the outcome is missing.
Check for relevant outcome frameworks, reporting standards, core outcome sets, or stakeholder priorities when applicable.
Phrase the gap at the level your search can actually support rather than claiming universal absence.