Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Does Research Help Us Make Decisions Under Uncertainty?

Research rarely gives decision-makers certainty. Its more realistic contribution is to reduce relevant uncertainty, compare plausible options, identify risks and trade-offs, and make the basis for a decision more explicit.

64
Research and Decisions Under Uncertainty Guide 64 of 533
01 · The Question

How Can We Decide When the Evidence Is Incomplete?

Many important decisions cannot wait until everything is known.

A physician may need to choose among treatments whose benefits and harms cannot be predicted perfectly for an individual patient. A school may need to decide whether to adopt an intervention before years of local evidence accumulate. A government may have to respond to an emerging problem while information is still incomplete. An organization may need to choose between competing strategies whose future outcomes remain uncertain.

Research is often expected to help. Yet research itself contains uncertainty. Samples do not perfectly represent every population. Measurements have limitations. Estimates have margins of error. Findings may depend on assumptions and context. Different studies may disagree.

So what exactly does research contribute if it cannot tell us with certainty what will happen?

02 · The Short Answer

Research Makes Uncertainty More Informative and More Manageable

In Brief

Research helps us make decisions under uncertainty by replacing some assumptions with systematically gathered evidence, estimating what is known and how confidently it is known, comparing possible options and outcomes, and revealing important uncertainties that remain.

Evidence should inform rather than mechanically dictate a decision. Decision-makers may also need to consider context, feasibility, costs, values, preferences, equity, acceptability, and potential consequences. Good evidence-informed decision-making makes both the evidence and these additional considerations explicit.

03 · What You Need to Know

Research Improves Decisions Without Promising Certainty

Uncertainty is normal, not evidence that research has failed

A decision is made under uncertainty whenever its relevant facts, causal relationships, future conditions, or outcomes are not completely known.

That describes a great many real decisions.

Research can reduce some uncertainty, but expecting it to eliminate uncertainty altogether sets an unrealistic standard. Even a strong study observes a particular set of people, conditions, measurements, and outcomes. Applying its findings elsewhere requires judgment about how well that evidence fits the new situation.

The purpose is therefore not necessarily to make uncertainty disappear. It is to improve what we know about the choices before us.

Research can estimate what is likely to happen

Instead of relying solely on intuition, research can provide empirical estimates of frequencies, associations, effects, risks, benefits, harms, preferences, experiences, or other relevant outcomes.

These estimates do not predict every individual case. They provide evidence about patterns observed under specified conditions.

A decision-maker can then ask a more useful question than "Will this definitely work?" The question becomes something closer to "Given the available evidence, what outcomes appear plausible, how large might they be, and how uncertain are those estimates?"

Research can compare alternatives

Many decisions are not choices between "evidence" and "no evidence." They are choices among alternatives.

Should an organization retain its current practice, modify it, or replace it? Which of several interventions appears to offer the most favorable balance of benefits and harms? Does one approach work better for particular populations or conditions?

Comparative research can provide evidence about these alternatives. Depending on the question and design, researchers may estimate differences in outcomes, identify conditions under which options perform differently, or document trade-offs that would otherwise remain hidden.

Research can tell us how uncertain an estimate is

A numerical result without information about its uncertainty can create false precision.

Statistical analyses often provide ways of expressing uncertainty around estimates, such as confidence intervals. Other approaches assess the certainty or quality of a broader body of evidence. Qualitative research can also make uncertainty visible by identifying variation in experiences, contextual differences, or competing interpretations that simple averages might obscure.

What matters is not merely obtaining a result. Decision-makers need some basis for judging how much confidence to place in it.

Evidence of an effect Research suggests that an outcome or difference occurs under the conditions studied.
Magnitude of an effect Research estimates how large that outcome or difference may be.
Certainty of the evidence An assessment of how confident we should be in the relevant body of evidence, considering its limitations.

Research can reveal what we still do not know

One of the most useful outcomes of research is sometimes a clearer map of ignorance.

A study may show that evidence is strong for one population but weak for another. It may reveal that an intervention's average effect is reasonably understood while its long-term harms remain uncertain. A systematic review may find that apparently confident recommendations rest on surprisingly limited evidence.

This is useful information. Decisions can be designed differently when uncertainty is known rather than hidden. Decision-makers may proceed cautiously, collect additional data, limit implementation, establish monitoring, or commission further research.

Evidence-informed does not mean evidence-determined

Research evidence is often only one input into a decision.

The World Health Organization describes evidence-informed decision-making as identifying, appraising, and mobilizing the best available evidence for policy and programmes. Its guidance also recognizes that decisions can involve multiple forms of evidence and practical considerations.

For example, an intervention might appear effective in research but be prohibitively expensive in a particular setting. Another may offer benefits while raising important equity concerns. Stakeholders may consider certain outcomes more important than others. Implementation may require infrastructure that does not exist locally.

Evidence therefore informs judgment; it does not abolish judgment.

Question for the Decision What Research May Contribute What Else May Matter
Does an option appear to work? Evidence about effects and their uncertainty Whether the evidence applies to the local context
What could go wrong? Evidence about harms, risks, unintended effects, and implementation problems Risk tolerance and consequences of being wrong
Which option should we choose? Comparative evidence about relevant outcomes Costs, feasibility, values, equity, preferences, and constraints
Will it work here? Evidence about populations, contexts, mechanisms, and variation Local conditions and implementation capacity
Should we wait for more evidence? Identification of important evidence gaps and uncertainty Urgency, reversibility, cost of delay, and consequences of action or inaction

Research can make the reasoning behind a decision more transparent

Without systematic evidence, decisions may still be made, but the assumptions behind them can remain implicit. Research can make some of those assumptions testable.

A decision-maker can identify which evidence supports a choice, where that evidence is weak, which considerations lie outside the research evidence, and what assumptions must hold for the decision to make sense.

This does not guarantee the correct decision. It does make the reasoning more open to scrutiny and revision.

That is part of why research offers something different from relying only on experience, tradition, or authority. Its methods and evidence can be examined rather than accepted solely because a particular person or institution endorses the conclusion.

The best decision can still lead to a bad outcome

This is one of the most important consequences of uncertainty.

Suppose the available evidence indicates that Option A has a better expected balance of benefits and harms than Option B. Choosing A can be reasonable even though an unfavorable outcome remains possible. Conversely, choosing poorly can occasionally produce a fortunate result.

We should therefore distinguish the quality of the decision process from the outcome of a single decision. Under uncertainty, good decisions are based on the information reasonably available at the time, not judged solely by whether events happened to turn out well afterward.

04 · A Practical Example

Research Can Change a Decision Without Providing a Certain Answer

Hypothetical Example

Should a university introduce a new student-support program?

Imagine a university is considering a program intended to improve first-year student retention. Administrators have limited resources and cannot know in advance exactly what will happen.

Initial uncertainty The university does not know whether the program will meaningfully improve retention, whether benefits will differ across student groups, or whether implementation will justify the cost.
Research evidence Relevant studies suggest that similar programs can improve particular student outcomes, but effects vary among settings and the evidence is not perfectly transferable to this institution.
Local evidence The university examines its own student data and gathers information about the needs and experiences of the population the program is intended to serve.
Remaining considerations Decision-makers examine costs, staffing, feasibility, equity, student preferences, possible unintended consequences, and how easily the program could be modified or discontinued.
Decision Rather than concluding that research has "proven" the program will work, the university may implement it on a limited basis while monitoring outcomes and revisiting the decision as new evidence becomes available.

Research has not eliminated uncertainty. It has changed the decision from an unsupported guess into a more explicit judgment informed by evidence, local conditions, and acknowledged uncertainty.

05 · What Researchers Often Get Wrong

Misunderstandings About Evidence, Decisions, and Certainty

Misconception

Should We Act Only When Research Gives Us Certainty?

No. Complete certainty is often unavailable, and waiting also has consequences. The relevant question is whether the available evidence is sufficient for the particular decision, given its urgency, risks, alternatives, and consequences of being wrong.

Misconception

Does a Statistically Significant Result Tell Us Which Decision to Make?

No. Statistical significance does not by itself establish the magnitude or practical importance of an effect, the certainty of the broader evidence, the balance of benefits and harms, feasibility, cost, equity, or whether the finding applies to the decision context.

Misconception

If Evidence Is Uncertain, Is It Useless?

No. Evidence can remain informative even when uncertainty is substantial. Knowing the plausible range of outcomes, the weaknesses of the evidence, and what remains unknown can improve a decision compared with pretending that uncertainty does not exist.

Misconception

Does Evidence-Based Mean We Should Follow Research Regardless of Context?

No. Contemporary evidence-informed approaches recognize that research evidence is considered alongside other relevant factors, which may include context, feasibility, resources, values, preferences, equity, and acceptability.

Misconception

If the Outcome Was Bad, Was the Decision Necessarily Bad?

No. Under uncertainty, even a well-supported choice can produce an unfavorable outcome. Decision quality should consider the evidence and reasoning available when the choice was made, not only the eventual result.

Misconception

Does More Research Always Solve the Decision Problem?

No. Additional research may reduce some uncertainties while leaving others unresolved, and waiting for more evidence can itself impose costs. Sometimes the appropriate response is further research; in other situations, decision-makers may need to act while monitoring outcomes and updating the decision as evidence develops.

06 · What This Means for You

Use Research to Improve the Decision, Not to Pretend Uncertainty Has Disappeared

Whether you are conducting research or using it, begin by identifying the uncertainty that actually matters to the decision.

Do you need to know whether an intervention has any meaningful effect? How large that effect might be? Whether it creates harms? Whether findings transfer to your population? Whether one option is better than another? The evidence required depends on the decision.

A simple decision framework

If strong relevant evidence exists
Use it while checking whether the populations, conditions, outcomes, and implementation context are sufficiently applicable.
If evidence exists but is uncertain
Identify what the uncertainty concerns and whether it could materially change the decision.
If local conditions differ substantially from the research context
Consider local evidence, stakeholder knowledge, feasibility, and whether implementation can be monitored or adapted.
If evidence is seriously inadequate and the decision can reasonably wait
Further research may have substantial value before committing to a consequential option.
If a decision cannot wait
Use the best available evidence, make assumptions explicit, consider risks and alternatives, and plan to revise the decision as new information becomes available.

This last point is particularly important. Evidence-informed decision-making is not a one-time transfer of findings from a paper into practice. Evidence changes, contexts change, and implementation itself can produce new information.

Research is therefore part of a learning process. Decisions can generate further questions, and those questions can motivate new research. This relationship is one reason research serves purposes beyond simply producing publications.

Watch Out

Do not hide uncertainty to make evidence appear more decisive. Decision-makers need to know not only what the research suggests but also how strong the evidence is, where it may not apply, and which important questions remain unanswered.

07 · A Quick Checklist

Before Using Research to Support a Decision

Ask:
What specific decision needs to be made, and which uncertainties could materially affect it?
What does the best available research actually establish, and what does it not establish?
How certain are the relevant estimates or conclusions?
Are the populations, settings, outcomes, and conditions in the evidence sufficiently relevant to this decision?
What benefits, harms, trade-offs, and unintended consequences should be considered?
What contextual factors, costs, values, preferences, equity considerations, or feasibility constraints matter alongside the research evidence?
What are the consequences of acting now, doing nothing, or waiting for additional evidence?
Can the decision be monitored, adapted, or reversed if new evidence changes what is known?
08 · Frequently Asked Questions

Questions About Research and Decisions Under Uncertainty

Can research ever eliminate uncertainty completely?

Rarely. Research can reduce particular uncertainties and provide more precise evidence, but limitations in data, measurement, sampling, assumptions, context, and future conditions usually leave some uncertainty. The relevant goal is often to make uncertainty sufficiently understood for the decision at hand.

What is evidence-informed decision-making?

Evidence-informed decision-making is a systematic approach in which the best available evidence is identified, appraised, and used to inform decisions while recognizing that other considerations may also matter. Depending on the decision, these can include context, feasibility, resources, equity, values, preferences, and acceptability.

Why say evidence-informed instead of evidence-based?

The term "evidence-informed" can emphasize that research evidence contributes to a decision without necessarily determining it by itself. Decisions frequently involve contextual, ethical, practical, economic, and stakeholder considerations that cannot be reduced to a single research finding.

Should we wait for stronger evidence before making a decision?

Sometimes, but not always. The answer depends on how consequential and urgent the decision is, how uncertain the existing evidence is, whether additional research is likely to change the choice, and what happens if action is delayed.

Can qualitative research help with decisions under uncertainty?

Yes. Qualitative research can illuminate experiences, implementation barriers, acceptability, contextual variation, mechanisms, and stakeholder perspectives that may be essential to understanding whether and how an option can work in practice.

Does more evidence always produce a better decision?

No. Evidence must be relevant, credible, appropriately interpreted, and connected to the actual decision. A large quantity of poorly applicable evidence may be less useful than a smaller body of high-quality evidence addressing the uncertainty that matters most.

What should researchers do when studies disagree?

Do not simply count how many studies support each conclusion. Examine differences in methods, populations, contexts, measurements, risk of bias, effect estimates, and certainty. When appropriate, systematic reviews and evidence syntheses can help evaluate the body of evidence more rigorously.

09 · The Bottom Line

Good Decisions Do Not Require Pretending We Know Everything

The Bottom Line

Research helps us make decisions under uncertainty by improving our estimates of what may happen, comparing alternatives, identifying risks and trade-offs, and showing both what the evidence supports and where uncertainty remains.

Research evidence is usually one part of a decision rather than an automatic instruction. The aim is not to wait indefinitely for certainty, but to combine the best relevant evidence with explicit consideration of context, consequences, feasibility, values, and other factors, then remain willing to revise the decision as knowledge changes.

10 · Sources and Further Reading

Authoritative Sources on Evidence-Informed Decision-Making

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes