Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Is a Gap Worth Filling if the Required Study Would Be Extremely Expensive?

An important research gap does not become unimportant because the study needed to address it is expensive. But high cost raises the threshold for proceeding because the expected value of better evidence must be weighed against feasibility, opportunity cost, and competing uses of research resources.

292
Is an Expensive Research Gap Worth Filling? Guide 292 of 533
01 · The Question

What if an Important Research Gap Would Cost an Enormous Amount to Resolve?

Some research gaps can be addressed with an existing dataset, a modest experiment, or a relatively small observational study. Others cannot.

The credible study might require thousands of participants, multiple institutions, specialized equipment, years of follow-up, expensive laboratory procedures, rare populations, or an intervention costly enough to evaluate at scale. You may be convinced that the uncertainty matters while simultaneously confronting a difficult question: is obtaining the answer worth what it would take?

Cost does not determine scientific importance. It does, however, affect whether filling a gap is a sensible use of limited research resources.

02 · The Short Answer

An Expensive Gap Can Be Worth Filling, but Importance Alone Is Not Enough

In Brief

Yes. A research gap can be worth filling even when the required study is extremely expensive, but the case becomes stronger when the uncertainty is consequential, better evidence could materially improve knowledge or decisions, and the expected value of that information plausibly justifies the resources required.

High cost should not automatically disqualify research, just as scientific importance should not automatically justify any expenditure. The appropriate judgment depends on what is at stake, how much useful uncertainty the study can reduce, whether less costly alternatives exist, and what other research those resources could support instead.

03 · What You Need to Know

Research Cost Changes the Decision About a Gap, Not the Existence of the Gap

An expensive gap can still be scientifically important

Suppose strong evidence is missing for an important question, and the only credible way to obtain it is a large, expensive study. The price of the study does not make the uncertainty disappear. Nor does it make the underlying question scientifically trivial.

It helps to separate two judgments.

Importance of the gap How consequential it would be to obtain better knowledge about the unresolved question.
Worth of the proposed study Whether this particular research project can reduce the important uncertainty enough to justify its costs, burdens, risks, and opportunity costs.

A gap can therefore be highly important while a proposed study addressing it is poor value. Conversely, an expensive study can be justified when the expected benefits of substantially better information are correspondingly large.

The relevant cost is more than the grant budget

When researchers describe a study as expensive, they often mean its direct financial cost. Research also consumes other scarce resources.

Participants contribute time and may accept inconvenience or risk. Research teams commit years of effort. Institutions provide facilities and administrative capacity. Specialized equipment may be unavailable for other projects. Funders face a finite budget.

The full question is therefore not simply, "Can somebody afford this study?" It is also, "What must be given up to conduct it?"

That second question concerns opportunity cost. Funding one very large study can mean funding fewer studies elsewhere. The alternative use of those resources is therefore relevant when deciding whether a costly gap should receive priority.

High cost raises the importance of expected information gain

Imagine two studies costing the same amount. One is likely to reduce uncertainty only slightly. The other could distinguish between competing conclusions that would lead to substantially different decisions.

The second study has a stronger informational case, other things being equal.

Value of information approaches formalize this general logic in decision analysis. They examine the expected benefit of reducing uncertainty and can be used to consider whether additional research is worthwhile. AHRQ has examined value-of-information modeling specifically as an approach to prioritizing future research needs.

You do not need a formal economic model for every research project. Still, the underlying question travels well across disciplines: How much useful information are we buying with the resources this study requires?

Consider what happens if the research is never conducted

The cost of research should be considered alongside the cost of remaining uncertain.

Suppose an expensive study could determine whether a widely implemented intervention actually produces enough benefit to justify its continuing cost. If the intervention will be used by millions of people over many years, even a very expensive study might be modest relative to the cumulative consequences of repeatedly making the wrong decision.

Alternatively, suppose the study concerns an uncertainty with little practical or scientific consequence. An enormous budget becomes much harder to defend.

This is why a small gap can warrant substantial research when the consequences of uncertainty are large. The amount of missing knowledge and the value of resolving it are different dimensions.

Ask whether different plausible answers would change anything important

Before supporting an expensive study, identify what its possible results could change.

If Result A would support one major decision while Result B would support another, reducing uncertainty may have considerable value. If every plausible result would leave policy, practice, theory, and subsequent research essentially unchanged, the informational return is more difficult to justify.

An expensive project therefore faces an especially demanding version of the question posed when a likely answer would produce little meaningful change.

Look for less costly ways to reduce the same uncertainty

An expensive proposed design should not be treated as inevitable merely because it is the first design considered.

Could existing datasets answer part of the question? Could multiple datasets be linked? Would a systematic review or individual-participant-data meta-analysis reduce enough uncertainty? Could a pilot or feasibility study determine whether the larger project is warranted? Could a more efficient design obtain comparable information with fewer participants? Could international or multi-institutional collaboration distribute infrastructure costs?

These alternatives will not always work. Some questions genuinely require large-scale research. But before committing major resources, it is reasonable to establish that the expensive design is proportionate to the evidence needed.

Do not make a cheaper study if it cannot answer the question

Cost containment can create its own problem. Researchers may shrink an expensive study until it fits the available budget, even when the resulting design can no longer resolve the important uncertainty.

A cheap but uninformative study is not necessarily better value than an expensive informative one.

Cochrane guidance on imprecision illustrates the broader methodological issue. When studies contain too few participants or events, estimates can remain too imprecise to distinguish among important possibilities. Merely conducting a smaller study does not solve the problem if the information produced remains inadequate.

If the affordable version of a project would provide evidence too weak to address the gap meaningfully, redesigning, collaborating, seeking greater resources, or postponing the study may be preferable.

Research priority is comparative

An expensive study is rarely evaluated in isolation. Funders, institutions, and research teams choose among competing opportunities.

AHRQ's work on research-gap prioritization emphasizes explicit criteria such as potential research impact, foundational importance, timeliness, and the need to allocate limited research funding effectively. Different funders and disciplines will reasonably use different criteria, but the comparative logic remains important.

A costly study may therefore be worth conducting and still rank below another project expected to produce greater benefit from the same resources. "Worthwhile" and "highest priority" are not synonyms.

Watch Out

Do not justify an enormous study merely by emphasizing how important the broad topic is. The relevant question is whether the specific uncertainty addressed by the study is consequential and whether this particular design can reduce it enough to justify the resources required.

04 · A Practical Example

When an Expensive Study Could Still Be Good Value

Hypothetical Example

A costly evaluation of a widely adopted educational intervention

Suppose a national educational system is considering long-term use of a costly digital intervention. Smaller observational studies suggest benefits, but methodological limitations prevent a confident estimate of whether the improvement is large enough to justify widespread implementation.

The gap Decision makers lack sufficiently credible evidence about the intervention's educational benefit relative to its substantial implementation cost.
The required study A credible evaluation would require many institutions, a large sample, extended follow-up, technical infrastructure, and substantial research funding.
Why the study is expensive A smaller project would leave the key effect estimate too uncertain and would not adequately capture implementation across different institutional contexts.
Why the answer could matter If the intervention produces meaningful benefits, the evidence could support continued investment. If benefits are negligible, the same evidence could prevent years of costly implementation.
The decision The study's large price tag should be compared with the value of resolving the uncertainty, the scale and duration of the decisions affected, and credible alternative research designs rather than treated as an automatic reason to proceed or stop.

Now suppose the intervention is already inexpensive, easily reversible, and the range of plausible effects would not change whether institutions use it. The same research budget becomes harder to justify because the consequences of uncertainty are smaller.

Cost is therefore meaningful only in relation to what the research is expected to accomplish.

05 · What Researchers Often Get Wrong

Common Mistakes When Evaluating Expensive Research

Misconception

If a Research Question Is Important, Is Any Cost Justified?

No. Importance strengthens the case for research but does not eliminate resource constraints or opportunity costs. The expected improvement in evidence should be considered alongside what the research requires and what alternative work those resources could support.

Misconception

If a Study Is Extremely Expensive, Should the Gap Be Abandoned?

Not automatically. A costly study may still be justified when unresolved uncertainty has very large consequences and the research can materially improve important decisions or scientific conclusions. Alternative designs and funding arrangements should also be considered before abandoning the question.

Misconception

Is a Smaller Study Always a Sensible Compromise?

No. Reducing sample size, follow-up, measurement quality, or scope can make a project cheaper while also making its evidence insufficient for the decision that motivated it. The cheaper design must still be capable of producing useful evidence.

Misconception

Does Getting Funding Prove the Study Is Worth the Cost?

No. Funding decisions reflect particular programs, priorities, review criteria, budgets, and institutional judgments. Receiving funding shows that a funder chose to support the project under those conditions; it does not establish a universal conclusion about the study's value.

Misconception

Should Cost Be Judged Only Against the Number of Publications Produced?

No. Publication count is a poor proxy for research value. A single expensive study that resolves an important uncertainty may be more informative than numerous inexpensive studies that leave the central question unanswered.

06 · What This Means for You

Compare the Cost of the Study With the Value of Reducing the Uncertainty

If the credible study needed to address your gap is expensive, do not begin by asking how to make the project cheaper. First determine what level of evidence the question actually requires.

A simple decision framework

If the gap is consequential and a costly study could substantially reduce decision-relevant uncertainty
The expense may be justified, particularly when the consequences of continued uncertainty are large.
If the gap is important but a less costly design could provide the evidence needed
Prefer the more efficient credible design rather than equating higher expenditure with better research.
If reducing the budget would make the study incapable of answering the question adequately
Do not conduct an under-informative version merely because it is affordable.
If the study is extremely expensive and the answer would change little
The gap has a weak claim to those resources unless another substantial scientific value can be demonstrated.
If another project could produce substantially greater value from the same resources
Recognize the opportunity cost even if the expensive study is worthwhile in isolation.

There is no universal monetary threshold above which a study becomes unjustifiable. A million-dollar study can be wasteful in one context and excellent value in another. What matters is the relationship among cost, evidence quality, consequences of uncertainty, and plausible benefits of obtaining a reliable answer.

07 · A Quick Checklist

Before Committing Major Resources to a Research Gap, Check This

Before deciding that an expensive study is worth conducting, check:
Define the exact uncertainty the study needs to reduce rather than relying on the importance of the broad topic.
Identify what scientific conclusions or consequential decisions could change under different plausible results.
Estimate the resources required beyond the grant budget, including time, participant burden, infrastructure, and institutional capacity.
Examine whether existing data, evidence synthesis, collaboration, or a more efficient design could answer the question adequately at lower cost.
Verify that reducing the scale of the study would not make its results too weak or imprecise to resolve the important uncertainty.
Consider the consequences and cumulative costs of continuing to make decisions without better evidence.
Compare the project with other research that could be supported using the same resources.
Make the prioritization criteria explicit rather than assuming that an important gap automatically deserves unlimited resources.
08 · Frequently Asked Questions

Questions About Expensive Studies and Research Gaps

How expensive is too expensive for a research study?

There is no universal monetary threshold. Cost must be interpreted relative to the importance of the uncertainty, the expected improvement in evidence, the scale of the consequences affected, available resources, and alternative uses of those resources.

Can a very expensive study still be cost-effective research?

Potentially. A high-cost study may still provide good value when better information can substantially improve consequential decisions or prevent large future costs, harms, or scientific misdirection. Establishing this formally may require economic or value-of-information analysis in settings where those methods are appropriate.

Should I reduce my sample size if the required study is too expensive?

Only if the smaller study remains capable of answering the research question adequately. Reducing sample size solely to fit the budget can leave estimates too imprecise to distinguish among important possibilities, defeating the purpose of the research.

Can a pilot study replace an expensive definitive study?

Usually not if the substantive question requires definitive evidence. A pilot or feasibility study can help determine whether a larger project is practicable, refine procedures, or estimate operational parameters, but it should not be presented as answering a question it was not designed to resolve.

Does an important societal problem justify expensive research?

It can strengthen the case, but the broad importance of the problem is insufficient by itself. The specific study should address consequential uncertainty and be capable of producing information useful enough to justify its resources and burdens.

What if nobody is willing to fund the study?

Lack of funding does not prove that the gap is unimportant. It may reflect cost, competing priorities, feasibility, timing, funder missions, or other considerations. The practical implication may be that the question requires collaboration, a different design, staged research, new infrastructure, or that it remains unresolved for the time being.

Can an expensive gap reasonably remain unfilled?

Yes. If the expected information gain is too small relative to the resources required, credible alternatives are unavailable, or higher-priority research offers substantially greater value, it may be reasonable to leave the research gap unfilled, at least until circumstances change.

09 · The Bottom Line

An Expensive Answer Can Be Worth Buying When the Uncertainty Is Costlier

The Bottom Line

An extremely expensive study can be worth conducting when the research gap is consequential, the study can materially reduce important uncertainty, and the expected value of better evidence plausibly justifies the resources and opportunity costs involved.

Do not treat cost as either an automatic veto or an irrelevant detail. Ask what the study would change, whether the same information can be obtained more efficiently, whether a cheaper design would remain informative, and what other valuable research would be displaced by the investment.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes