03 · What You Need to Know
The Value of Research Depends Partly on What Better Information Enables
A genuine gap can still be low priority
Finding an unanswered question establishes uncertainty. It does not establish priority.
This distinction is central to research prioritization. AHRQ's work on future research needs does not stop at identifying evidence gaps. It also considers prioritization of those gaps so that future research can produce evidence useful to decision makers. That separation reflects a basic principle: researchers can identify more unanswered questions than any research system could realistically investigate.
The next question is therefore not merely "Can we study this?" but "What would be gained by studying it?"
The counterfactual test: imagine that the answer becomes known
A useful way to evaluate a gap is to imagine that a rigorous study has already been completed and its answer is trustworthy.
Now compare that world with the present one.
Theory Would the result support, challenge, distinguish between, refine, or constrain an important explanation?
Practice or policy Could different plausible findings lead to different actions, recommendations, interventions, standards, or resource decisions?
Methodology Could the answer change how an important phenomenon should be measured, analyzed, modeled, or studied?
Future research Could the answer determine which questions should be pursued, which assumptions remain defensible, or which research investments should be avoided?
If the credible answer is "no" across all relevant forms of contribution, the gap may still be intellectually interesting, but its claim to priority becomes harder to defend.
Different possible answers should ideally have different implications
Another useful test is to ask what you would do under different plausible results.
Suppose your study could reasonably produce Result A, Result B, or Result C. If your interpretation, recommendation, theory, or next research decision would remain essentially identical under all three, then obtaining greater certainty about which result is correct may have limited value.
Decision-theoretic approaches formalize a related idea. Value of information analysis evaluates the benefit of additional information according to the extent to which reducing uncertainty can improve expected decisions. When better information cannot improve a decision, its decision value is correspondingly limited.
This framework was developed extensively in health economics and policy research, and its formal methods are not automatically transferable to every research question. The broader reasoning, however, is useful across disciplines: uncertainty matters more when different resolutions of that uncertainty lead to meaningfully different consequences.
"Nothing changes in practice" does not mean "nothing changes"
Practical application is only one possible contribution.
A study may not alter professional practice or public policy but still discriminate between competing theories. It may establish a descriptive baseline needed for future work. It may validate an important measurement instrument, test the reproducibility of an influential finding, document a phenomenon before it disappears, or establish whether a widely assumed relationship actually exists.
In these cases, something meaningful changes in the state of scientific knowledge even if nobody changes a policy tomorrow morning.
This is why a scientifically real but practically unimportant gap can still deserve research. Practical importance and scientific importance should not be collapsed into one criterion.
Confirmatory evidence can matter even when the expected answer is unsurprising
Researchers sometimes assume that a study has little value if they already expect its answer. That conclusion does not necessarily follow.
There is an important difference between expecting an answer and possessing sufficiently credible evidence for it. A rigorous replication, validation study, or confirmatory test may matter when an influential conclusion currently rests on fragile evidence.
The relevant question is not whether the result will surprise you. It is whether obtaining stronger evidence would change how confidently an important claim should be treated.
Negative or null findings can still change what should happen next
Likewise, research value should not be equated with obtaining a positive result.
A credible finding of little or no meaningful effect may discourage investment in an ineffective intervention, weaken a theoretical prediction, close an unproductive line of inquiry, redirect resources, or prevent researchers from repeatedly asking the same question.
In such cases, the answer matters precisely because it can tell people what not to pursue.
Curiosity-driven research does not need an invented practical impact
Some research is undertaken because understanding the world is itself a legitimate scientific objective. Basic and exploratory research can produce value that is difficult to forecast in advance, and later applications may emerge unpredictably.
It would therefore be too strong to require every study to demonstrate an immediate change in theory, practice, policy, or an established research program.
But acknowledging uncertainty about future value is different from claiming that every unanswered question deserves equal resources. When funding, participant burden, researcher time, laboratory capacity, or other scarce resources are involved, opportunity costs remain relevant.
If you cannot identify any credible scientific, practical, methodological, or informational value, you should at least ask why this gap should be filled before another one.
The cost of obtaining the answer changes the threshold
The same low-impact question may be judged differently depending on what answering it requires.
A modest analysis of an existing dataset may impose little additional cost or participant burden. A multicenter longitudinal study requiring substantial funding and thousands of participants demands a much stronger justification.
Formal value of information approaches make this relationship explicit by comparing the expected benefit of additional information with the cost of obtaining it. Even outside contexts where formal modeling is appropriate, the principle is useful: the resources required to answer a question affect how much value the answer should plausibly provide.
This becomes particularly important when considering whether a gap remains worth filling when the required study is extremely expensive.
Opportunity cost is easy to overlook
Research resources devoted to one question cannot simultaneously be devoted to another. Participant time, funding, staff effort, equipment, institutional support, and attention are finite.
A low-value study therefore has a cost even when it produces technically valid knowledge. The relevant comparison is not always "study versus no study." It may be "this study versus a different study that could resolve a more consequential uncertainty."
This is why not every missing piece of knowledge necessarily deserves its own study.
Watch Out
Do not manufacture practical implications merely to make a study appear consequential. If the principal contribution is theoretical, descriptive, methodological, confirmatory, or exploratory, say so. A modest but defensible contribution is stronger than an implausible promise that the findings will transform policy or practice.
06 · What This Means for You
Ask What Becomes Different Once the Gap Is Filled
Before turning a genuine gap into a project, imagine that the study has succeeded. You now possess a credible answer. What can someone understand, decide, test, design, avoid, or investigate differently because of it?
The answer does not need to involve sweeping societal impact. It does need to provide a defensible reason for acquiring the information.
A simple decision framework
If different plausible findings would change an important theoretical conclusion
The gap may have substantial scientific value even without immediate practical application.
If different findings could change practice, policy, design, resource allocation, or another consequential decision
The gap has a stronger practical justification.
If the answer could determine which future research should or should not proceed
Count that informational value rather than dismissing the study because it has no immediate application.
If every plausible answer would leave all relevant conclusions and decisions essentially unchanged
Treat the gap as lower priority unless another credible form of scientific value exists.
If the expected value is modest but answering the question requires substantial resources or participant burden
Compare the project explicitly with higher-value uses of those resources.
This evaluation should be proportionate. Not every dissertation or exploratory study needs a formal decision model. But every research project benefits from a clear answer to a deceptively simple question: Why is having this evidence preferable to continuing without it?
If no persuasive answer emerges, it may be reasonable to leave the gap unfilled.
07 · A Quick Checklist
Before Studying a Gap, Ask What the Answer Could Change
Before deciding that the gap deserves a study, check:
State the specific uncertainty your study would reduce rather than relying on a general claim that research is lacking.
Identify at least one credible scientific, practical, methodological, or informational consequence of obtaining a reliable answer.
Compare what would happen under the main plausible findings rather than assuming that any result would be useful.
Ask whether the answer could change confidence in an important existing claim even if it would not change immediate practice.
Consider whether the result could prevent unnecessary future research or redirect subsequent investigation.
Avoid inventing practical or policy implications that are not plausibly connected to the question.
Compare the expected value of the answer with the cost, participant burden, time, and opportunity cost of obtaining it.
Consider whether another unresolved question offers a more consequential use of the same research resources.