Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Do You Compare a Small Certain Contribution With a Large but Uncertain Contribution?

A dependable small contribution and a potentially large but uncertain contribution represent different research strategies. Compare not only their best outcomes, but also how likely each is to produce useful knowledge, what happens when things go wrong, and how much risk your circumstances can absorb.

193
Small Certain vs. Large Uncertain Contribution Guide 193 of 533
01 · The Question

Would You Rather Add a Little Knowledge Reliably or Risk More for a Much Larger Contribution?

Some research choices present an uncomfortable trade-off.

Idea A is dependable. The methods are established, the data are accessible, and the study is highly likely to produce interpretable evidence. Its contribution, however, will probably be modest.

Idea B could do considerably more. It might resolve an important uncertainty, challenge an influential explanation, establish a new method, or open a productive research direction. But its contribution is uncertain because the study itself is harder, the scientific premise is less established, or both.

How should you compare a contribution that is relatively small but dependable with one that is potentially large but uncertain?

There is no universal rule that research should maximize certainty or ambition. Even formal research assessment recognizes both sides of the problem. NIH's current peer-review framework considers importance alongside rigor and feasibility and specifically instructs reviewers, when feasibility is less certain, to consider whether that uncertainty is balanced by the potential for major advances.

02 · The Short Answer

Compare the Full Distribution of Possible Contributions, Not Just the Best Outcome

In Brief

Compare a small certain contribution with a large uncertain contribution by considering both the value of what each project could add and the probability that it will produce useful, interpretable knowledge, including what happens when the ambitious outcome does not occur.

The larger potential contribution becomes more attractive when it addresses a consequential problem, its uncertainty is scientifically justified, and less favorable outcomes would still teach you something. The smaller contribution may be preferable when the ambitious project's downside is largely uninformative or when failure would impose costs you cannot reasonably absorb.

03 · What You Need to Know

The Trade-Off Is About More Than Probability Times Impact

First, Be Precise About What “Small” and “Large” Mean

Research contribution is not measured on a universal scale.

A “small” contribution might replicate an established finding in a consequential new setting, provide a more precise estimate, validate a measurement tool, extend evidence to an overlooked population, or clarify one boundary condition. None is necessarily trivial.

A “large” contribution might substantially change an explanation, resolve a persistent controversy, introduce a method that enables previously impossible research, provide strong evidence about an important intervention, or open a new line of inquiry.

Before comparing the projects, describe the actual contribution each could make. Labels such as incremental and transformative can otherwise do more rhetorical work than analytical work.

“Certain” Rarely Means Guaranteed

Research almost always contains uncertainty. Participants may behave unexpectedly. Measurements can be noisy. Analyses may reveal patterns different from those anticipated. Replications may not reproduce earlier findings.

A small “certain” contribution is therefore usually better understood as a contribution with relatively predictable execution and a high likelihood of producing interpretable evidence.

Similarly, a large uncertain contribution does not mean the project is a lottery ticket. There should still be a defensible rationale for believing the larger contribution is plausible.

Separate the Size of the Contribution From the Probability of Producing It

One reason this decision is difficult is that two dimensions vary simultaneously.

Contribution magnitude How much the resulting knowledge could change understanding, methods, evidence, decisions, or future research.
Contribution uncertainty How uncertain it is that the project will actually produce that level of useful knowledge.

A project can have high potential contribution and high uncertainty. Another can have moderate potential contribution and low uncertainty. Neither characteristic alone establishes which project is preferable.

A Simple Expected-Value Analogy Can Clarify the Trade-Off

It can be useful to think informally in terms of expected contribution: a large possible contribution should be discounted when the chance of realizing it is low.

Suppose, purely as a hypothetical illustration, that you rate the scientific value of a modest project's successful contribution as 4 on an arbitrary scale and believe it has a 90% chance of producing that contribution. You rate an ambitious project's potential contribution as 10 but believe it has only a 40% chance of producing that particular outcome.

A Decision Aid, Not a Research Metric
Expected contribution ≈ potential contribution × probability of realizing it
Potential contribution is a judgment about the scientific value of the outcome. Probability is a judgment about how likely the project is to produce that outcome. Neither is normally known with precision.
Hypothetical illustration: 4 × 0.90 = 3.6 for the modest project; 10 × 0.40 = 4.0 for the ambitious project.

The ambitious project appears slightly higher under these assumptions. That does not mean it is objectively the better project. Change the assumed probabilities or values slightly and the result may reverse.

More importantly, the simple calculation ignores other possible outcomes. The ambitious study might fail to produce its maximum contribution yet still generate useful methodological or empirical knowledge.

The exercise is valuable mainly because it forces you to ask what assumptions are driving your preference. It does not create a validated metric of research value.

Do Not Treat Failure as a Single Zero Outcome

The ambitious project may have several possible outcomes rather than “breakthrough” or “nothing.”

Perhaps the new method works but the substantive hypothesis is unsupported. Perhaps the intervention fails but the study identifies why. Maybe the theory is not supported, yet the evidence eliminates one influential explanation. A pilot may reveal that the approach is infeasible, saving substantial resources in future research.

These outcomes can still contribute.

Possible outcome Potential research value
Ambitious hypothesis supported Potentially large contribution
Ambitious hypothesis not supported but study is rigorous May eliminate or weaken a plausible explanation
New method partly succeeds May identify methodological improvements and future applications
Critical feasibility assumption fails May provide useful feasibility evidence if tested systematically
Study becomes uninterpretable because execution fails Often little scientific contribution

The important distinction is whether unfavorable outcomes remain informative.

Large Potential Contribution Does Not Justify Arbitrarily Low Probability

It is easy to construct a grand best-case scenario. A project could transform the field, establish a new paradigm, or solve a major problem. Those claims matter only if there is a credible pathway from the proposed study to that outcome.

NIH's High-Risk, High-Reward Research program supports highly innovative projects with potential for broad impact, but its existence should not be interpreted as a general endorsement of poorly grounded speculation. High-risk research still needs a compelling scientific rationale.

A tiny probability multiplied by an extravagant claim does not automatically produce a good research decision.

The Small Contribution May Be More Valuable Than It Sounds

Researchers can undervalue dependable incremental work because “incremental” sounds unimpressive.

Yet cumulative science depends on reliable estimation, replication, validation, extension, measurement improvement, and evidence that establishes boundary conditions. The FINER framework itself treats novelty broadly enough to include confirming, refuting, or extending previous findings.

A modest study may also become highly consequential when the result informs an immediate decision or provides a foundation for later research.

Do not confuse smaller contribution with negligible contribution.

The Large Contribution May Create Options Beyond the Immediate Study

Some ambitious projects are valuable partly because success changes what becomes possible next.

A validated method may support many subsequent studies. Access to a difficult population may establish a durable research partnership. A new dataset may become a platform for several questions. Evidence supporting a novel mechanism may generate an entire program of research.

This option value is difficult to capture in a simple one-study comparison, but it can matter when the project could become the foundation of several related studies.

Your Capacity to Absorb Failure Matters

Two researchers can rationally make different choices between the same projects.

A doctoral student with one year remaining and no alternative dataset may reasonably prefer the dependable contribution. A research group with multiple projects, established infrastructure, and funding for exploratory work may reasonably accept greater uncertainty.

This is not merely psychological risk tolerance. It concerns actual consequences.

If an ambitious project's failure would prevent graduation, violate a project commitment, exhaust the available budget, or leave no publishable or otherwise useful output, the downside deserves substantial weight.

The Comparison Changes When Risk Can Be Reduced

The ambitious project's uncertainty is not always fixed.

A pilot may establish feasibility. A collaborator may supply missing expertise. Preliminary data may clarify whether the central premise is plausible. A staged design may allow the project to stop or change direction before the most expensive phase.

Before choosing the smaller contribution, ask whether you can make the larger opportunity less uncertain without destroying what makes it valuable.

This is central to deciding when a riskier research idea becomes worth pursuing.

Consider a Portfolio Rather Than Forcing Every Project Into the Same Risk Profile

If you control several projects, you may not need to choose exclusively between dependable and ambitious research as general strategies.

A portfolio can contain projects with different combinations of expected contribution and uncertainty. Relatively dependable work can generate knowledge, infrastructure, preliminary evidence, or resources that support more speculative questions.

This is different from pursuing unrelated projects indiscriminately. The strongest portfolios often connect the studies so that one reduces uncertainty for another.

Do Not Forget Opportunity Cost

Choosing the dependable project has a cost beyond the resources it consumes: you are not using those resources on the ambitious alternative.

Choosing the ambitious project has the same problem in reverse.

The relevant question is therefore not whether either project is worthwhile in isolation. It is whether one is the better use of your scarce research capacity compared with the alternative.

That is the same broader logic involved in choosing the strongest idea when several are worth pursuing.

04 · A Practical Example

Comparing a Dependable Extension With a Larger but Uncertain Contribution

Hypothetical Example

Two possible studies of AI-supported learning

Suppose a research team is considering two hypothetical projects.

Idea A replicates and extends an established finding about AI-supported feedback using a new but theoretically relevant student population. The methods are well established, access is secured, and the team expects the study to produce a useful estimate even if the original effect is not reproduced.

Idea B tests a new adaptive feedback method intended to respond dynamically to students' misconceptions. If successful, it could provide substantially stronger evidence about personalized AI-supported learning, but the adaptive method has not yet been validated and implementation is technically demanding.

Consideration Idea A Idea B
Potential contribution Modest but useful Potentially large
Execution uncertainty Low High
Value if expected result does not occur Still informative as replication and extension Depends on why the method or intervention fails
Future option value Moderate High if the adaptive method proves viable
Risk-reduction opportunity Limited need Prototype and pilot testing
First: The team identifies that Idea B's largest risk comes from the unvalidated adaptive method rather than from the substantive research question.
Next: They prototype the method and conduct a smaller validation study before committing to the full experiment.
If validation succeeds: Idea B becomes substantially more attractive because an avoidable source of uncertainty has been reduced while the larger potential contribution remains.
If validation fails: The team has learned something before committing the resources required for the full study, and Idea A may become the stronger immediate project.

The choice therefore changes as information changes. The comparison is not between fixed labels of “safe” and “ambitious,” but between evolving estimates of what each project can realistically contribute.

05 · What Researchers Often Get Wrong

Common Mistakes When Comparing Certain and Uncertain Contributions

Misconception

The Larger Possible Contribution Should Always Win

Best-case impact is only part of the decision. Consider how plausible that contribution is, what the study produces under less favorable outcomes, and whether execution risks can leave the project uninterpretable.

Misconception

The Certain Contribution Is Automatically the Responsible Choice

Reliability matters, but consistently choosing the smallest predictable contribution can impose an opportunity cost if consequential questions remain unaddressed. Responsible research judgment includes deciding when additional uncertainty is justified.

Misconception

You Can Calculate the Correct Choice With Expected Value

An expected-value analogy can expose assumptions, but research contributions and success probabilities are rarely measured on common, precise scales. A numerical result should support reasoning rather than masquerade as an objective answer.

Misconception

If the Ambitious Hypothesis Is Wrong, the Project Contributes Nothing

A rigorous study can remain valuable when a prediction is unsupported. The more serious concern is whether failure in recruitment, measurement, implementation, or another execution component prevents meaningful interpretation.

Misconception

Incremental Research Is Unimportant Research

Replication, validation, extension, improved estimation, and careful testing of boundary conditions can make consequential contributions. The size of the conceptual leap is not the only form of research value.

06 · What This Means for You

Compare What You Are Likely to Learn, Not Merely What You Hope to Discover

When one project offers a dependable modest contribution and another a potentially larger one, map the plausible outcomes rather than comparing only the headline versions of the ideas.

A simple decision framework

If the ambitious project's potential contribution is only slightly larger
Substantially greater execution risk may be difficult to justify.
If the potential contribution is much larger and scientifically plausible
Greater uncertainty may be worth accepting when the study retains a credible path to informative evidence.
If less favorable outcomes would still answer useful questions
Do not treat the project as though anything short of its maximum contribution equals failure.
If execution failure would make the ambitious study largely uninterpretable
Reduce the risk, require a stronger upside, or prefer the more dependable alternative.
If one project must carry an essential degree or contractual outcome
Give greater weight to dependable production of useful evidence.
If you can pursue a coherent portfolio of studies
Consider combining different risk profiles rather than demanding that every project maximize either certainty or potential impact.

One practical question captures much of the trade-off: How much more could I learn from the ambitious project, and how much more likely is it that I will learn very little?

07 · A Quick Checklist

Before Choosing the Smaller Certain or Larger Uncertain Contribution

Before deciding, check:
Can you describe the actual contribution of each project without relying on labels such as incremental or transformative?
How likely is each project to produce interpretable evidence rather than merely reach completion?
What plausible outcomes exist between complete success and complete failure?
Would an unsupported hypothesis still produce useful knowledge?
Which failure modes would make the project genuinely uninformative?
Can the largest execution risks be reduced before you commit to the full project?
What future research opportunities would each successful project create?
How costly would failure be given your available time, funding, degree requirements, team, and alternative projects?
Are you undervaluing the dependable project because its contribution sounds less dramatic?
08 · Frequently Asked Questions

Questions About Certain and Uncertain Research Contributions

Is a small but certain research contribution worth pursuing?

Yes, when the contribution itself is meaningful. Replication, validation, improved estimation, extension, and carefully established boundary conditions can provide valuable cumulative evidence even when the expected advance is modest.

How can I estimate the probability of a research project succeeding?

Usually with considerable uncertainty. Instead of inventing a precise percentage, identify specific failure modes and use relevant preliminary evidence, prior studies, pilot results, recruitment experience, technical validation, and expert input where available.

Should I calculate an expected value for each research idea?

You can use expected-value reasoning as a conceptual aid, but research value and success probabilities are rarely known precisely enough to make the resulting number objective. Its main benefit is exposing assumptions about contribution and uncertainty.

Does a failed high-risk project make no contribution?

Not necessarily. A rigorous study can produce useful evidence even when its hypothesis is unsupported or a new approach proves ineffective. The weakest failure modes are those that leave the research question unanswered because execution itself broke down.

Should doctoral researchers prefer smaller certain contributions?

A fixed degree timeline and dependence on one project may justify greater emphasis on execution reliability. That does not require trivial research. An ambitious component can sometimes be paired with a dependable core or preceded by work that reduces its major risks.

Can a pilot change which project I should choose?

Yes. A pilot can provide information about recruitment, measurement, procedures, technical performance, or other feasibility assumptions, potentially reducing uncertainty enough to make an ambitious project more defensible.

When should I definitely prefer the smaller contribution?

No universal rule makes the smaller project mandatory. It becomes more attractive when it remains scientifically worthwhile, the ambitious project's extra contribution is speculative or modest, execution failure is likely to be uninformative, and you cannot reasonably absorb the consequences of that failure.

09 · The Bottom Line

Do Not Compare a Guaranteed Modest Result With the Ambitious Project's Best-Case Scenario

The Bottom Line

Compare a small relatively certain contribution with a large uncertain contribution by considering the value and plausibility of the full range of outcomes, especially whether the ambitious project can still produce useful knowledge when its best-case result does not occur.

A dependable contribution can be scientifically valuable, while greater uncertainty can be justified by a genuinely larger opportunity. Examine failure modes, reduce avoidable risks, consider what each outcome would teach you, and account for how much failure your circumstances can absorb before deciding which use of your research capacity is stronger.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes