Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Can Research Be Worth Doing Mainly Because It Rules Out an Explanation?

Research can make an important contribution by showing that a plausible explanation does not fit the evidence. The key is distinguishing genuine evidence against an explanation from a study that simply failed to detect an effect.

78
Can Ruling Out an Explanation Make Research Valuable? Guide 78 of 533
01 · The Question

Can Finding Out What Is Wrong Be a Meaningful Research Contribution?

Researchers often imagine a valuable study as one that discovers the correct explanation for something. You identify a problem, test possible causes, and eventually explain what is happening. But research does not always progress so neatly.

Sometimes a study cannot tell us what the correct explanation is. What it can do is show that one apparently plausible explanation is inconsistent with the evidence, too weak to account for the phenomenon, or unlikely under the conditions examined.

That may sound like an incomplete result. After all, if you have ruled out one explanation but still cannot say what the answer is, what exactly have you contributed?

02 · The Short Answer

Yes, Eliminating a Plausible Explanation Can Advance Knowledge

In Brief

Research can be worth doing mainly because it provides credible evidence against an important and plausible explanation, thereby narrowing what researchers should continue to consider.

The qualification matters: merely obtaining a statistically non-significant result does not automatically rule anything out. The study must be capable of distinguishing the explanation from relevant alternatives, and its design, measurement, precision, and analysis must support the stronger conclusion.

03 · What You Need to Know

Eliminating Explanations Is Part of Building Better Knowledge

Research does not advance only by accumulating confirmed explanations

Suppose researchers have several credible explanations for the same phenomenon. If a well-designed study substantially weakens one of them, researchers now face a smaller and better-defined set of possibilities.

They may not yet know which remaining explanation is correct. Nevertheless, their state of knowledge has changed.

This illustrates why the purpose of research extends beyond producing a completely new finding. Research can also test existing claims, correct mistaken assumptions, discriminate among explanations, establish boundaries, and refine what can reasonably be believed.

Elimination can therefore be informative. Knowing that an attractive explanation is inadequate may redirect theoretical development, prevent later studies from repeatedly pursuing the same account, or force researchers to consider mechanisms that previously received less attention.

Ruling something out is stronger than failing to find it

This is the most important distinction in the entire discussion.

No evidence detected The study did not obtain sufficiently persuasive evidence for the expected effect or relationship. This may remain inconclusive.
Evidence against the explanation The results provide a defensible basis for concluding that the proposed explanation, effect, or a practically meaningful version of it is unlikely under the conditions studied.

A conventional non-significant result does not, by itself, establish the second conclusion. A study can fail to detect an effect because the effect is absent, but it can also fail because the sample is too small, measurements are noisy, implementation is weak, assumptions are violated, or the true effect is smaller than the study was capable of detecting.

This is the familiar distinction between absence of evidence and evidence of absence. Recent methodological work on replication of null findings reinforces this point: statistically non-significant results may remain inconclusive unless the study and analysis are designed to evaluate evidence for the absence of a meaningful effect.

Watch Out

Do not write that your research has “ruled out” an explanation simply because p >.05. Statistical non-significance alone does not demonstrate that an effect is absent or that an explanation is false.

What would count as evidence against an explanation?

There is no single test that applies to every discipline or research design. In general, however, the study must generate observations that would be difficult to reconcile with the explanation being evaluated while addressing credible competing reasons for obtaining those observations.

For quantitative studies concerned with whether an effect is absent or too small to matter, researchers may need approaches specifically suited to that question. Depending on the research problem, these can include confidence intervals interpreted relative to a meaningful effect size, equivalence testing, Bayesian approaches such as Bayes factors, or other model-comparison procedures.

For qualitative, historical, theoretical, or case-based research, ruling out an explanation may instead depend on evidence such as incompatible observations, failed predictions, process evidence, contradictory records, comparison among cases, or the inability of an explanation to account for critical features of the phenomenon.

The methodological details differ, but the underlying principle is similar: the evidence must actually bear on the explanation you claim to have weakened.

The explanation needs to be plausible enough to be worth testing

Not every rejected idea constitutes an important contribution. Researchers could invent countless implausible explanations and design studies showing that they are wrong. Eliminating them would add little.

The value of ruling out an explanation depends partly on its prior plausibility and importance. Was it supported by theory? Had previous studies suggested it? Was it commonly assumed in professional practice? Would researchers reasonably have pursued it without stronger contrary evidence?

A study that challenges a serious contender contributes more than one that rejects an explanation nobody had good reason to believe.

Ruling out an explanation can redirect subsequent research

Consider a field in which three mechanisms might explain an observed pattern. Researchers may repeatedly design studies around all three because none has been adequately tested.

If credible evidence makes one mechanism substantially less plausible, subsequent research can concentrate on the remaining possibilities or develop alternatives. This is one way research can be valuable because it makes better future studies possible.

The benefit is not simply that researchers now possess one more published finding. Their search space has changed.

Negative evidence can also correct a distorted literature

Scientific literatures do not necessarily contain a representative sample of all studies that have been conducted. Research reporting positive or statistically significant findings has historically been more likely to appear in the published record in many contexts, contributing to publication bias.

This matters because a literature containing mostly supportive findings can make an explanation appear more secure than the complete evidence warrants. Reporting rigorous negative or null findings can help produce a more accurate evidential record and may improve later evidence synthesis.

The value of such findings depends on their quality. A poorly designed negative study does not become informative merely because the literature needs more negative results. Methodological rigor remains the relevant standard.

Some explanations can only be narrowed, not completely eliminated

Researchers should also be cautious with the phrase rule out. Scientific explanations often contain assumptions, boundary conditions, auxiliary hypotheses, and predictions that can be revised when contrary evidence appears.

A study may therefore justify a more precise conclusion: perhaps an explanation does not account for the phenomenon under these conditions, cannot produce an effect of a practically meaningful magnitude, or is inconsistent with a particular prediction.

That is not rhetorical weakness. It is often a more accurate description of what the evidence establishes.

04 · A Practical Example

When Eliminating One Explanation Changes the Research Question

Hypothetical Example

Why are students leaving an online course?

Imagine that researchers repeatedly observe that students who experience technical difficulties are more likely to leave an online course. One plausible explanation is straightforward: technical problems themselves cause disengagement.

A research team designs a study capable of examining that explanation more carefully. It measures technical difficulties reliably, accounts for important competing factors, and obtains estimates precise enough to evaluate whether the proposed relationship is large enough to explain the observed pattern.

Initial explanation Technical difficulties are thought to be a major reason students disengage.
Critical test The researchers examine predictions that should follow if technical difficulties are an important explanatory mechanism.
Result The evidence indicates that the proposed mechanism cannot plausibly account for much of the observed disengagement under the conditions studied.
Interpretation The researchers do not yet know what primarily explains disengagement, but confidence in one important explanation should decrease.
Next step Subsequent studies can give greater attention to other mechanisms rather than continuing to assume that technical difficulties provide the main explanation.

The contribution is therefore not “we found nothing.” Something consequential has been learned: one plausible route to explaining the phenomenon has become less credible.

05 · What Researchers Often Get Wrong

Common Mistakes When Research Appears to Reject an Explanation

Misconception

A Non-Significant Result Proves the Explanation Is Wrong

No. A non-significant result can be compatible with an absent effect, but it can also arise when the study provides insufficient information to distinguish an effect from no effect. Researchers need to examine precision, study design, measurement, relevant effect sizes, and the analytical approach before making claims about absence.

Misconception

If One Explanation Is Wrong, Its Competitor Must Be Right

Eliminating explanation A does not automatically establish explanation B. There may be other explanations that were never tested, combinations of mechanisms, or conditions under which several accounts remain plausible. Evidence against one hypothesis should not be silently converted into evidence for another.

Misconception

Negative Findings Mean the Study Failed

The success of a study should not be defined by whether the preferred hypothesis survived. Rigorous evidence that challenges a plausible explanation can contribute to scientific self-correction and help prevent a field from becoming disproportionately shaped by supportive findings.

Misconception

Every Failed Hypothesis Is Worth Publishing

Negative findings vary greatly in informativeness. A result may add little when the original hypothesis was poorly motivated, the study could not test it adequately, or the evidence remains too imprecise to distinguish among meaningful possibilities. The important question is what the evidence allows researchers to learn.

Misconception

One Study Can Permanently Eliminate an Explanation

Sometimes evidence is decisive, but scientific conclusions are usually conditional on methods, populations, measurements, assumptions, and contexts. Replication and converging evidence may be needed before an explanation can be rejected with substantial confidence.

06 · What This Means for You

Ask Whether Your Study Can Actually Discriminate Among Explanations

If your research is intended to challenge or eliminate an explanation, design it around that objective from the beginning. Do not conduct a conventional study designed to detect an effect and then reinterpret an inconclusive result as proof that the explanation is wrong.

A simple decision framework

If the explanation makes a distinctive prediction
Design the study so that the predicted observation can be meaningfully distinguished from credible alternatives.
If you want to argue that a meaningful effect is absent
Use a design and analytical approach capable of evaluating evidence for absence or practical equivalence rather than relying solely on non-significance.
If the evidence weakens only part of the explanation
State the boundary precisely instead of claiming that the entire explanation has been disproven.
If several explanations remain plausible
Describe what has been narrowed and what remains unresolved.
If the result is simply inconclusive
Treat uncertainty as the finding rather than forcing the study into a stronger negative conclusion.

This also provides a useful way to think about research that produces no immediate change in practice, policy, or behavior. Correcting an explanation may initially affect only what researchers believe. That can still matter if subsequent research would otherwise have proceeded from a mistaken premise.

Most importantly, match your language to the strength of the evidence. “We found no statistically significant association,” “the data were inconclusive,” “the results are inconsistent with the predicted pattern,” and “effects larger than the prespecified threshold are unlikely” are not interchangeable claims.

07 · A Quick Checklist

Before Claiming That Research Has Ruled Out an Explanation

Before making the claim, check:
Was the explanation plausible and important enough that weakening it would genuinely advance understanding?
Did the study directly test a prediction or implication of the explanation?
Was the study sufficiently informative to distinguish evidence against the explanation from an inconclusive result?
For quantitative research, have you examined effect estimates, uncertainty, and an appropriate method for evaluating the absence of a meaningful effect where relevant?
Have measurement problems, implementation failures, and important alternative interpretations been considered?
Are you avoiding the mistake of treating statistical non-significance as proof of no effect?
Are you avoiding the opposite mistake of treating evidence against one explanation as automatic confirmation of another?
Does your conclusion state exactly what has become less plausible and under what conditions?
08 · Frequently Asked Questions

Questions About Research That Rules Out Explanations

Is ruling out a hypothesis the same as obtaining a null result?

No. A null or statistically non-significant result may be inconclusive. Ruling out a hypothesis requires evidence and a research design capable of supporting a conclusion against the relevant explanation or against effects large enough to matter.

Does p >.05 mean there is no effect?

No. A conventional non-significant result indicates that the analysis did not provide sufficient evidence to reject the null hypothesis at the chosen threshold. It does not by itself establish that the true effect is zero or practically negligible.

How can researchers obtain evidence that an effect is absent?

The appropriate method depends on the research question. In quantitative research, options may include equivalence testing, confidence intervals evaluated against meaningful effect thresholds, Bayesian model comparison, or related approaches specifically designed to evaluate evidence for absence.

Can qualitative research rule out an explanation?

Potentially. Qualitative evidence may reveal observations, processes, sequences, or cases that are inconsistent with an explanation or make it substantially less credible. The logic and strength of the inference depend on the research design and the claim being evaluated.

Is a study valuable if it rejects an explanation but finds no replacement?

It can be. Narrowing the plausible explanations for an important phenomenon may redirect subsequent inquiry even when the correct explanation remains unknown. The value depends on how credible and consequential the eliminated explanation was.

Should negative results be published?

Rigorous and informative negative findings should be part of the research record. Selective non-publication of negative or null results can distort the apparent balance of evidence, although not every inconclusive or poorly designed study becomes informative simply because its result is negative.

Can one study completely disprove a theory?

Sometimes evidence can strongly contradict a critical prediction, but broader theories may contain multiple propositions and assumptions. Researchers should specify exactly which prediction, mechanism, effect, or boundary condition the evidence challenges rather than claiming more than the study establishes.

09 · The Bottom Line

Knowing Which Explanation Does Not Work Can Move Research Forward

The Bottom Line

Research can be worth doing primarily because it provides credible evidence against an important explanation, narrowing the possibilities researchers need to investigate and correcting what the field can reasonably believe.

The crucial distinction is between evidence against an explanation and failure to obtain evidence for it. If the study cannot make that distinction, the appropriate conclusion may be uncertainty rather than rejection.

10 · Sources and Further Reading

Sources on Negative Evidence and Ruling Out Explanations

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes