03 · What You Need to Know
Research value is not the same as the amount of uncertainty
Start with the decision, not merely the knowledge gap
A conventional justification for research often begins with the literature: something is unknown, understudied, inconsistent, or insufficiently precise. These observations can establish that uncertainty exists. They do not necessarily establish that reducing it would be valuable.
A decision-oriented perspective asks a different question. Suppose the uncertainty disappeared tomorrow. Would anyone make a better choice because of what was learned?
The relevant decision might concern clinical treatment, educational practice, public policy, organizational strategy, allocation of resources, adoption of a technology, or the direction of subsequent research. In each case, evidence has practical value partly because it may help a decision-maker choose more effectively among alternatives.
This reasoning underlies value of information approaches in decision analysis. These approaches evaluate the expected benefit of acquiring additional information that reduces uncertainty surrounding a decision. The framework has been developed particularly extensively in health economics and health policy, although its underlying decision-theoretic logic is more general.
Uncertainty matters when being wrong has consequences
Imagine two possible actions, A and B. Current evidence suggests that A is preferable, but considerable uncertainty remains. If future evidence could reveal that B is actually preferable, then acting now creates some possibility of choosing the inferior option.
The importance of that uncertainty depends partly on what would happen if the wrong option were chosen. A small probability of error can matter greatly when the consequences are severe, widespread, expensive, difficult to reverse, or persistent. Conversely, substantial uncertainty may matter relatively little when the competing options produce nearly equivalent outcomes.
This is why the consequences attached to uncertainty can be at least as important as the size of the uncertainty itself.
Amount of uncertainty
How unsure we currently are about the relevant evidence, parameter, effect, or outcome.
Value of reducing uncertainty
How much better our expected decisions or outcomes could become if additional information reduced that uncertainty.
The answer must have some possibility of affecting what should be done
Suppose researchers are uncertain whether an intervention produces an average improvement of 10.1 or 10.4 units on an outcome. A large and expensive study could estimate the effect much more precisely. Yet if either result would lead to exactly the same decision, the additional precision may have little decision value.
By contrast, uncertainty around whether the effect is beneficial or harmful could be highly consequential if the answer determines whether the intervention should be adopted.
The distinction is subtle but important. Research can produce more precise knowledge without producing a correspondingly valuable improvement in decisions. This is why greater precision does not automatically make additional evidence valuable.
The value of information can be understood as avoiding the consequences of a wrong decision
In formal value-of-information analysis, a decision-maker first identifies the option with the greatest expected payoff given current evidence. Because the evidence is uncertain, that option may turn out not to be the best one.
Additional information has value when it reduces the expected opportunity loss associated with making a decision under uncertainty. Put more intuitively, information is valuable because it may help us avoid choices we would later have made differently had we known more.
One formal concept is the expected value of perfect information (EVPI). EVPI compares the expected outcome of making the best decision with current information against the expected outcome if uncertainty relevant to the decision could be resolved perfectly. It therefore represents an upper bound on what completely eliminating that uncertainty would be worth in the specified decision problem.
Perfect information and realistic research are not the same thing
EVPI asks what uncertainty would be worth eliminating completely. Real studies rarely achieve that. Samples are finite, measurements contain error, study designs have limitations, and some uncertainty remains after new evidence is collected.
Other value-of-information measures address more realistic questions. The expected value of partial perfect information (EVPPI) considers the value of completely resolving uncertainty in particular parameters or groups of parameters. The expected value of sample information (EVSI) estimates the expected value of information obtainable from a particular proposed study rather than from hypothetical perfect knowledge.
These distinctions become especially important when deciding whether further research is actually needed before making a decision. The theoretical value of eliminating all uncertainty can be substantial while the value of the evidence obtainable from a feasible study is much smaller.
The number of people affected can change the value of an answer
Research findings may influence one decision once, or they may inform repeated decisions affecting many people over several years. That difference can substantially alter the value of information.
Consider a small improvement in decision quality. For a single low-consequence decision, the expected benefit may be modest. If the same evidence informs thousands of recurring decisions, however, small improvements can accumulate into a much larger population-level benefit.
This is one reason formal value-of-information analyses may consider the population expected to be affected and the period over which the information remains relevant. The appropriate population and time horizon depend on the actual decision problem.
Information is valuable only relative to what is already known
A research question cannot be evaluated in isolation from the existing evidence. If current knowledge already supports one option strongly enough that plausible new findings are unlikely to alter the preferred decision, the remaining uncertainty may have limited decision value.
The opposite can also occur. Two alternatives may currently appear almost equally attractive. Even a moderate reduction in uncertainty could then have substantial value because relatively modest evidence might change which option should be preferred.
The important question is therefore not simply whether uncertainty exists, but which uncertainty is actually worth reducing.
The value of knowing is not necessarily the value of conducting a study
This distinction prevents an important conceptual mistake. Information may be valuable while a particular study designed to obtain it is not.
A study consumes money, researcher time, participant effort, institutional capacity, and other resources. Research can also impose opportunity costs because resources devoted to one question cannot simultaneously be used elsewhere. In some settings, waiting for evidence can itself have consequences if a beneficial action is postponed while research proceeds.
For that reason, the expected benefit of additional information eventually needs to be considered alongside the cost of obtaining it and the cost of remaining uncertain.
Watch Out
A high potential value of information does not automatically justify any proposed study. The relevant comparison is between the expected value of the information a feasible study can produce and the full consequences of obtaining that information, including research costs, opportunity costs, and, where relevant, the consequences of delay.
Not every form of research value can be reduced to an immediate decision
A decision-oriented framework is powerful, but it should not be stretched into a universal definition of scholarly worth. Some research develops theory, creates measurement tools, identifies phenomena, builds datasets, tests methods, or establishes foundational knowledge whose eventual applications cannot be specified confidently in advance.
Basic and exploratory research can therefore be valuable even when no immediate policy or practice decision hinges on the next result. Likewise, intellectual, scientific, educational, cultural, and capacity-building benefits may matter even when they are difficult to represent in a formal decision model.
The practical lesson is narrower: when a study is being justified because its findings are supposed to improve a decision, the connection between uncertainty, information, and that decision should be made explicit.
06 · What This Means for You
Ask what would change if your study answered the question
When developing an applied research question, do not stop after demonstrating that the literature contains uncertainty. Trace the logic one step further. Identify who faces the relevant decision, what alternatives are available, what remains uncertain, and what could happen if the wrong option is selected.
Then ask whether evidence that your proposed study could realistically produce has a meaningful chance of changing that decision or improving its expected consequences.
A simple decision framework
If different plausible answers would lead to different consequential decisions
The information may have substantial practical value, so investigate whether further research could reduce the relevant uncertainty.
If different plausible answers would lead to essentially the same decision
Question whether additional precision would materially improve outcomes before committing substantial research resources.
If the uncertainty matters but a feasible study would reduce very little of it
Reconsider the study design, the information being collected, or whether another uncertainty should receive priority.
If useful information is obtainable but the study is expensive or waiting carries important consequences
Compare the expected benefit of the research with its costs and the consequences of delaying action.
If several research questions compete for limited resources
Compare their potential to improve consequential decisions rather than ranking them solely by novelty or uncertainty.
This reasoning also changes how research priorities can be framed. Instead of asking only, “What do we know least about?”, it may be more useful to ask which question would be most valuable to answer next.
In some cases, that question will expose a large and consequential evidence gap. In others, it may reveal that enough is already known to act. Research is not automatically the appropriate response to every remaining uncertainty.
07 · A Quick Checklist
Before claiming that a research question is worth answering
Before prioritizing the question, check:
Identify the specific uncertainty the proposed research would reduce.
Identify the decision, outcome, or other benefit that better information could influence.
Ask whether different plausible answers would actually favor different actions.
Consider the consequences of choosing incorrectly with current information.
Consider how many people, organizations, or future decisions could be affected by the information.
Determine how much uncertainty a realistic study could actually reduce rather than assuming perfect information.
Compare the expected benefit of better information with the resources required to obtain it.
Consider whether waiting for additional evidence could itself impose costs or delay beneficial action.
If the research is primarily foundational rather than decision-oriented, state that form of value explicitly instead of forcing an artificial immediate decision justification.