Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

What Is the Value of Knowing the Answer to a Research Question?

A research question is valuable to answer not simply because its answer is unknown, but because knowing the answer may improve consequential decisions. Learn how uncertainty, consequences, decision change, and research costs determine the practical value of new knowledge.

425
The Value of Knowing an Answer Guide 425 of 533
01 · The Question

Is an unanswered research question automatically worth answering?

Researchers are trained to notice what is not yet known. A gap appears in the literature, findings conflict, or an important relationship remains uncertain. The natural response is to propose another study.

But the existence of uncertainty does not, by itself, establish the value of reducing it. Some unanswered questions matter greatly because different answers would lead people to make different choices. Other questions may be intellectually interesting yet have little practical consequence because the same decision would be reasonable regardless of what further research finds.

This creates a deeper question for research prioritization: what would actually become better if we knew the answer?

02 · The Short Answer

The value lies in what better knowledge allows us to do

In Brief

Knowing the answer to a research question has practical value when reducing uncertainty can improve a consequential decision, reduce the expected losses from making the wrong decision, or otherwise produce benefits that justify obtaining the information.

A large knowledge gap is therefore not necessarily a high-value research opportunity. The importance of the uncertainty, the consequences of being wrong, whether better evidence could change action, who would benefit, and the cost of obtaining that evidence all matter.

03 · What You Need to Know

Research value is not the same as the amount of uncertainty

Start with the decision, not merely the knowledge gap

A conventional justification for research often begins with the literature: something is unknown, understudied, inconsistent, or insufficiently precise. These observations can establish that uncertainty exists. They do not necessarily establish that reducing it would be valuable.

A decision-oriented perspective asks a different question. Suppose the uncertainty disappeared tomorrow. Would anyone make a better choice because of what was learned?

The relevant decision might concern clinical treatment, educational practice, public policy, organizational strategy, allocation of resources, adoption of a technology, or the direction of subsequent research. In each case, evidence has practical value partly because it may help a decision-maker choose more effectively among alternatives.

This reasoning underlies value of information approaches in decision analysis. These approaches evaluate the expected benefit of acquiring additional information that reduces uncertainty surrounding a decision. The framework has been developed particularly extensively in health economics and health policy, although its underlying decision-theoretic logic is more general.

Uncertainty matters when being wrong has consequences

Imagine two possible actions, A and B. Current evidence suggests that A is preferable, but considerable uncertainty remains. If future evidence could reveal that B is actually preferable, then acting now creates some possibility of choosing the inferior option.

The importance of that uncertainty depends partly on what would happen if the wrong option were chosen. A small probability of error can matter greatly when the consequences are severe, widespread, expensive, difficult to reverse, or persistent. Conversely, substantial uncertainty may matter relatively little when the competing options produce nearly equivalent outcomes.

This is why the consequences attached to uncertainty can be at least as important as the size of the uncertainty itself.

Amount of uncertainty How unsure we currently are about the relevant evidence, parameter, effect, or outcome.
Value of reducing uncertainty How much better our expected decisions or outcomes could become if additional information reduced that uncertainty.

The answer must have some possibility of affecting what should be done

Suppose researchers are uncertain whether an intervention produces an average improvement of 10.1 or 10.4 units on an outcome. A large and expensive study could estimate the effect much more precisely. Yet if either result would lead to exactly the same decision, the additional precision may have little decision value.

By contrast, uncertainty around whether the effect is beneficial or harmful could be highly consequential if the answer determines whether the intervention should be adopted.

The distinction is subtle but important. Research can produce more precise knowledge without producing a correspondingly valuable improvement in decisions. This is why greater precision does not automatically make additional evidence valuable.

The value of information can be understood as avoiding the consequences of a wrong decision

In formal value-of-information analysis, a decision-maker first identifies the option with the greatest expected payoff given current evidence. Because the evidence is uncertain, that option may turn out not to be the best one.

Additional information has value when it reduces the expected opportunity loss associated with making a decision under uncertainty. Put more intuitively, information is valuable because it may help us avoid choices we would later have made differently had we known more.

One formal concept is the expected value of perfect information (EVPI). EVPI compares the expected outcome of making the best decision with current information against the expected outcome if uncertainty relevant to the decision could be resolved perfectly. It therefore represents an upper bound on what completely eliminating that uncertainty would be worth in the specified decision problem.

Conceptual Calculation
EVPI = Expected payoff with perfect information − Expected payoff with current information
The payoff represents whatever outcome the decision analysis treats as valuable, expressed in an appropriate common measure. The exact formulation depends on the decision context.
Suppose the best decision using current evidence has an expected payoff of 80 units. If uncertainty could be resolved before choosing, the expected payoff would rise to 86 units. The EVPI is 6 units. This means that completely resolving the relevant uncertainty could improve the expected outcome by at most 6 units under the assumptions of the model. It does not mean that an actual study will necessarily produce that full benefit.

Perfect information and realistic research are not the same thing

EVPI asks what uncertainty would be worth eliminating completely. Real studies rarely achieve that. Samples are finite, measurements contain error, study designs have limitations, and some uncertainty remains after new evidence is collected.

Other value-of-information measures address more realistic questions. The expected value of partial perfect information (EVPPI) considers the value of completely resolving uncertainty in particular parameters or groups of parameters. The expected value of sample information (EVSI) estimates the expected value of information obtainable from a particular proposed study rather than from hypothetical perfect knowledge.

These distinctions become especially important when deciding whether further research is actually needed before making a decision. The theoretical value of eliminating all uncertainty can be substantial while the value of the evidence obtainable from a feasible study is much smaller.

The number of people affected can change the value of an answer

Research findings may influence one decision once, or they may inform repeated decisions affecting many people over several years. That difference can substantially alter the value of information.

Consider a small improvement in decision quality. For a single low-consequence decision, the expected benefit may be modest. If the same evidence informs thousands of recurring decisions, however, small improvements can accumulate into a much larger population-level benefit.

This is one reason formal value-of-information analyses may consider the population expected to be affected and the period over which the information remains relevant. The appropriate population and time horizon depend on the actual decision problem.

Information is valuable only relative to what is already known

A research question cannot be evaluated in isolation from the existing evidence. If current knowledge already supports one option strongly enough that plausible new findings are unlikely to alter the preferred decision, the remaining uncertainty may have limited decision value.

The opposite can also occur. Two alternatives may currently appear almost equally attractive. Even a moderate reduction in uncertainty could then have substantial value because relatively modest evidence might change which option should be preferred.

The important question is therefore not simply whether uncertainty exists, but which uncertainty is actually worth reducing.

The value of knowing is not necessarily the value of conducting a study

This distinction prevents an important conceptual mistake. Information may be valuable while a particular study designed to obtain it is not.

A study consumes money, researcher time, participant effort, institutional capacity, and other resources. Research can also impose opportunity costs because resources devoted to one question cannot simultaneously be used elsewhere. In some settings, waiting for evidence can itself have consequences if a beneficial action is postponed while research proceeds.

For that reason, the expected benefit of additional information eventually needs to be considered alongside the cost of obtaining it and the cost of remaining uncertain.

Watch Out

A high potential value of information does not automatically justify any proposed study. The relevant comparison is between the expected value of the information a feasible study can produce and the full consequences of obtaining that information, including research costs, opportunity costs, and, where relevant, the consequences of delay.

Not every form of research value can be reduced to an immediate decision

A decision-oriented framework is powerful, but it should not be stretched into a universal definition of scholarly worth. Some research develops theory, creates measurement tools, identifies phenomena, builds datasets, tests methods, or establishes foundational knowledge whose eventual applications cannot be specified confidently in advance.

Basic and exploratory research can therefore be valuable even when no immediate policy or practice decision hinges on the next result. Likewise, intellectual, scientific, educational, cultural, and capacity-building benefits may matter even when they are difficult to represent in a formal decision model.

The practical lesson is narrower: when a study is being justified because its findings are supposed to improve a decision, the connection between uncertainty, information, and that decision should be made explicit.

04 · A Practical Example

Two unanswered questions can have very different research value

Hypothetical Example

Which uncertainty should an education system investigate?

Suppose an education system is considering whether to adopt a new digital tutoring program across many schools. Existing studies suggest that the program probably improves learning outcomes, but uncertainty remains about whether the improvement is large enough to justify its substantial implementation cost.

Researchers also know very little about whether students prefer one of two visually different dashboard layouts used within the program.

Both are genuine knowledge gaps. The dashboard question may even have greater uncertainty because almost no evidence exists. But uncertainty alone does not determine which answer has greater practical value.

Question 1: Does the tutoring program produce enough benefit to justify adoption? Different credible answers could change whether the system invests substantial resources in the program.
Question 2: Which dashboard layout do students slightly prefer? The answer might improve interface design, but suppose either result would leave the adoption decision and expected learning outcomes essentially unchanged.
Interpretation Question 1 may have greater decision value even if researchers are more uncertain about Question 2, because resolving Question 1 has greater potential to prevent a consequential wrong decision.
Action Before prioritizing either study, researchers should examine how much the relevant uncertainty matters to the decision, what evidence a feasible study could provide, and whether the expected benefit of that information justifies its cost.

The example does not imply that preference research is inherently unimportant. If interface design substantially affected engagement, accessibility, learning, or implementation, that uncertainty could become consequential. Research value depends on the decision context rather than on the topic label alone.

05 · What Researchers Often Get Wrong

Common mistakes when judging the value of an unanswered question

Misconception

If something is unknown, researching it must be valuable

An unanswered question establishes uncertainty, not necessarily the value of resolving it. Ask what decisions or outcomes could improve if the uncertainty were reduced.

Misconception

The largest research gap should receive the highest priority

A large gap can concern a low-consequence issue, while a relatively small uncertainty can sit directly at a decision threshold with major consequences. Research priority therefore depends on more than the amount of missing knowledge.

Misconception

More precise evidence is always useful

Precision can have scientific value, but its decision value may be small when plausible improvements in precision would not alter the preferred action. The practical question is what better precision enables someone to decide differently or more confidently for good reason.

Misconception

If information would be valuable, the proposed study must be worth funding

The value of resolving uncertainty is not identical to the value of a particular study. A feasible study may resolve only part of the uncertainty, and its expected benefit must be considered alongside its costs and other consequences.

Misconception

Research has value only if it changes an immediate decision

That conclusion goes too far. Decision value is one important form of research value, especially for applied questions. Foundational, theoretical, methodological, and exploratory work can contribute knowledge without being tied to a single immediate choice.

06 · What This Means for You

Ask what would change if your study answered the question

When developing an applied research question, do not stop after demonstrating that the literature contains uncertainty. Trace the logic one step further. Identify who faces the relevant decision, what alternatives are available, what remains uncertain, and what could happen if the wrong option is selected.

Then ask whether evidence that your proposed study could realistically produce has a meaningful chance of changing that decision or improving its expected consequences.

A simple decision framework

If different plausible answers would lead to different consequential decisions
The information may have substantial practical value, so investigate whether further research could reduce the relevant uncertainty.
If different plausible answers would lead to essentially the same decision
Question whether additional precision would materially improve outcomes before committing substantial research resources.
If the uncertainty matters but a feasible study would reduce very little of it
Reconsider the study design, the information being collected, or whether another uncertainty should receive priority.
If useful information is obtainable but the study is expensive or waiting carries important consequences
Compare the expected benefit of the research with its costs and the consequences of delaying action.
If several research questions compete for limited resources
Compare their potential to improve consequential decisions rather than ranking them solely by novelty or uncertainty.

This reasoning also changes how research priorities can be framed. Instead of asking only, “What do we know least about?”, it may be more useful to ask which question would be most valuable to answer next.

In some cases, that question will expose a large and consequential evidence gap. In others, it may reveal that enough is already known to act. Research is not automatically the appropriate response to every remaining uncertainty.

07 · A Quick Checklist

Before claiming that a research question is worth answering

Before prioritizing the question, check:
Identify the specific uncertainty the proposed research would reduce.
Identify the decision, outcome, or other benefit that better information could influence.
Ask whether different plausible answers would actually favor different actions.
Consider the consequences of choosing incorrectly with current information.
Consider how many people, organizations, or future decisions could be affected by the information.
Determine how much uncertainty a realistic study could actually reduce rather than assuming perfect information.
Compare the expected benefit of better information with the resources required to obtain it.
Consider whether waiting for additional evidence could itself impose costs or delay beneficial action.
If the research is primarily foundational rather than decision-oriented, state that form of value explicitly instead of forcing an artificial immediate decision justification.
08 · Frequently Asked Questions

Questions about the value of answering research questions

Does every research question need to solve a practical problem?

No. Basic, theoretical, exploratory, and methodological research may create important knowledge without addressing an immediate practical decision. The decision-oriented framework is most directly applicable when research is justified as evidence for choosing among actions.

Is a large research gap evidence that another study is needed?

Not by itself. A gap indicates missing knowledge. Whether another study is worthwhile also depends on the consequences of that uncertainty, the decisions it affects, how much useful information research could produce, and the cost of obtaining it.

Can a small uncertainty be worth researching?

Yes. Even modest uncertainty can matter when a decision has large consequences, affects many people, is difficult to reverse, or lies close to a threshold at which the preferred action changes.

Can a large uncertainty have little practical value?

Yes. If resolving the uncertainty would not materially affect a consequential decision or outcome, its decision value may be limited even when researchers know very little about the issue.

What is the expected value of perfect information?

Expected value of perfect information, or EVPI, is the expected improvement in payoff that would result if uncertainty relevant to a decision could be resolved completely before choosing an action. It represents an upper bound on the value of eliminating that uncertainty, not the expected value of any particular real-world study.

Does valuable information automatically justify delaying a decision?

No. Waiting can have consequences. When action is urgent or delay is costly, it may be preferable to act using imperfect evidence rather than wait for additional research.

Can additional research ever have negative value?

The information produced may have some benefit while the overall research activity is still not worthwhile if its costs and opportunity costs exceed that benefit. In this broader sense, research that consumes resources without sufficiently improving knowledge or decisions can have negative net value.

09 · The Bottom Line

A question matters because of the value of its answer, not merely because it remains unanswered

The Bottom Line

Knowing the answer to a research question is especially valuable when better information can reduce consequential uncertainty and improve the decisions people make.

Do not equate a large knowledge gap with a high-value research opportunity. Consider what could change if the answer became known, the consequences of being wrong with current evidence, how much uncertainty a feasible study could reduce, who would benefit, and what obtaining that information would cost.

10 · Sources and Further Reading

Sources and further reading on the value of information

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes