Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

What Should You Do When the Theory Suggests One Relationship but the Evidence Suggests Another?

When evidence differs from theoretical expectations, neither the theory nor the data should win automatically. Learn how to investigate the discrepancy before deciding whether it reflects uncertainty, measurement, context, design, or a genuine theoretical challenge.

218
When Theory and Evidence Disagree Guide 218 of 223
01 · The Question

Your Framework Predicted One Thing, but Your Results Point Somewhere Else. Now What?

You developed a hypothesis from a well-established theoretical framework. Previous literature gave you reason to expect a positive relationship. Your study was designed around that expectation.

Then the analysis produces something else.

Perhaps the relationship is weak or absent. Perhaps it runs in the opposite direction. A predicted mediator does not behave as expected. A qualitative pattern challenges the categories through which you initially understood the phenomenon. Or an effect appears only in a context where the theory suggested it should be general.

This is not automatically a methodological disaster, nor is it permission to declare the theory wrong. A discrepancy between theoretical expectation and empirical evidence is something to explain, investigate, and delimit before it becomes a conclusion.

02 · The Short Answer

Do Not Force the Evidence to Fit the Theory, but Do Not Abandon the Theory After One Unexpected Result

In Brief

When your evidence differs from what the theory led you to expect, report the discrepancy transparently and investigate plausible explanations involving the evidence, measurement, analysis, design, context, population, assumptions, and theoretical scope before claiming that the theory has been contradicted or should be revised.

An unexpected finding can reflect many things: sampling uncertainty, measurement limitations, analytical choices, contextual boundary conditions, an incorrect auxiliary assumption, or a genuine limitation in the theoretical explanation. Your task is to determine which interpretations your study can support and which remain possibilities for further research.

03 · What You Need to Know

Theory-Evidence Disagreement Is a Research Problem to Investigate, Not an Embarrassment to Hide

A hypothesis represents an expectation, not a contractual obligation imposed on the data. Hypotheses are formulated so that empirical evidence can bear on them. Methodological guidance describes hypotheses as testable predictions derived from research questions and existing knowledge. A meaningful test must therefore permit the possibility that the predicted result will not occur.

When theory and evidence diverge, the first task is to characterize exactly what has diverged.

Start by stating what the theory actually predicted

Researchers sometimes discover that the “theoretical prediction” was less explicit than they remembered.

Return to the original theoretical source rather than relying only on a diagram, textbook summary, or another empirical paper that cited the theory.

Does the theory explicitly predict the relationship? Does it specify a direction? Does the proposition apply to your population and context? Does it depend on assumptions or conditions that are absent from your study?

A theory may say that X influences Y under condition C. If your study examines X and Y where C is absent, the unexpected finding may not contradict the theory at all.

Then state what your evidence actually shows

A non-significant result does not necessarily show that “there is no relationship.” A statistically significant coefficient does not automatically establish that the theoretically proposed mechanism is correct. An unexpected qualitative theme does not by itself invalidate the framework.

Describe the empirical result at the level your analysis supports.

The evidence did not support the predicted relationship A claim about what happened in this study under its design, measures, sample, analysis, and uncertainty.
The theory is false A much broader claim requiring considerably more justification than one unsupported prediction usually provides.

Keeping these claims separate prevents a local empirical result from becoming an unnecessarily sweeping theoretical conclusion.

Check whether the constructs were represented adequately

A theory concerns conceptual entities and relationships. Your study observes operationalizations of those concepts.

If the theory predicts that perceived autonomy increases intrinsic motivation but your measure captures general satisfaction rather than autonomy, disagreement between the result and theory may partly reflect construct representation rather than theoretical failure.

Ask whether the measures have appropriate validity evidence for their intended interpretation and use in the population and context under study. In qualitative research, ask whether the data collection and analysis gave adequate access to the theoretical phenomenon rather than assuming that the presence of relevant vocabulary establishes conceptual correspondence.

Check whether the analysis actually tested the theoretical proposition

A theoretical mechanism and a statistical association are not necessarily the same thing.

Suppose a theory proposes that X influences Y through mediator M. Finding an association between X and Y does not establish the proposed mechanism. Likewise, finding no simple bivariate association does not necessarily evaluate a more complex conditional proposition correctly.

Return to the hypothesis and analysis plan. Did the study actually evaluate the relationship that the framework proposed? This is why hypotheses need to correspond to the conceptual framework before their empirical support can be meaningfully interpreted.

Consider uncertainty before constructing an elaborate explanation

Observed estimates contain uncertainty. Small samples, imprecise estimates, noisy measures, missing data, low event rates, model instability, and sampling variation can all affect what a particular study observes.

Do not treat the point estimate alone as the truth that theory must explain.

Examine effect estimates, uncertainty intervals where appropriate, data quality, robustness, assumptions, and the total pattern of evidence. A theoretically predicted effect that is estimated imprecisely is a different situation from a precise estimate indicating a substantively important effect in the opposite direction.

Look for boundary conditions

Some of the most interesting discrepancies occur because a relationship is more context-dependent than originally assumed.

A theory developed among experienced employees may behave differently among first-year university students. A model established for voluntary technology adoption may not transfer straightforwardly to mandatory institutional use. A relationship found in individualistic cultural contexts may operate differently elsewhere. An intervention mechanism may depend on implementation conditions that were absent in the new setting.

Such findings may suggest a boundary condition: circumstances under which a theoretical proposition appears more or less applicable.

But use that interpretation carefully. One contextual difference does not prove that the context caused the discrepancy. It provides a theoretically plausible explanation that may require further investigation.

Consider competing explanations rather than choosing the most convenient one

An unexpected finding often admits several explanations:

  • the theoretical proposition may not hold in this context;
  • the constructs may have been operationalized inadequately;
  • the sample may differ in a theoretically important way;
  • an unmodeled moderator or confounder may matter;
  • implementation may differ from what the theory assumes;
  • the analysis may depend on questionable assumptions;
  • the observed pattern may reflect sampling variation;
  • the original theoretical interpretation may need refinement.

Your discussion should evaluate plausible explanations according to evidence, not according to which explanation preserves the preferred theory.

Do not repair the theory after seeing the results and call it a prediction

Suppose your framework predicted a positive relationship. The result is negative. You then notice a theoretical passage that could plausibly explain the negative relationship and rewrite the discussion as though that was what the framework predicted all along.

That obscures the actual sequence of inquiry.

A better approach is to say that the original prediction was not supported and then explain how the unexpected result suggests an alternative interpretation. The distinction between prediction and post hoc explanation matters because hypotheses should ordinarily be established before the relevant results are known.

Unexpected findings can generate new hypotheses

Disagreement does not end the research process. It may begin another one.

An unexpected relationship can motivate a new mediator, moderator, contextual condition, mechanism, or theoretical refinement. The important distinction is that a hypothesis generated from the observed pattern should subsequently face new evidence rather than being treated as independently confirmed by the same evidence that generated it.

That preserves the difference between exploration and confirmation.

Do not treat a famous theory as immune to evidence

The opposite error is excessive theoretical deference.

Researchers sometimes assume that when evidence conflicts with an established theory, the study must be wrong. Established theories often have substantial evidentiary support, so methodological scrutiny is appropriate. But reputation does not make a theoretical proposition unfalsifiable.

If carefully conducted studies repeatedly produce credible evidence inconsistent with a prediction, theoretical modification, narrower scope conditions, or competing explanations may become warranted.

Theory is useful partly because it organizes expectations that can encounter empirical resistance.

Do not treat one study as a referendum on an entire theory

A theory may contain several constructs, propositions, mechanisms, and scope conditions. One study often examines only a subset.

If your evidence fails to support one predicted relationship, the most defensible conclusion may concern that proposition in the population and context examined, not the validity of the entire theoretical system.

This follows from the principle that a study may legitimately examine only part of a broader framework. The theoretical implications of its findings should be bounded accordingly.

Sometimes the conflict exposes a deeper alignment problem

Before interpreting an unexpected result as theoretically interesting, check whether the study was capable of testing the proposition in the first place.

If the method could not generate the required evidence, the apparent conflict may be an artifact of question-method mismatch. If the analysis uses variables that poorly represent the theoretical constructs, the problem may originate in operationalization. If the research question asks something different from what the framework explains, the conflict may be conceptual rather than empirical.

Watch Out

“Contrary to the theory” is a strong statement. Before writing it, verify that the theory really made the prediction, your operationalization represents the relevant constructs, your design can examine the proposition, and your analysis addresses it appropriately. Otherwise, the evidence may conflict with your implementation of the theory rather than with the theory itself.

04 · A Practical Example

When a Predicted Positive Relationship Turns Negative

Hypothetical Example

Institutional support and instructors' intention to use educational technology

Suppose a conceptual framework predicts that stronger perceived institutional support will be associated with greater instructor intention to adopt a new educational technology. Previous studies generally suggest a positive relationship.

In a new study, however, perceived institutional support is negatively associated with intention.

Do not rewrite the prediction Report that the hypothesized positive relationship was not supported and that the observed association was in the opposite direction.
Check the evidence Examine measurement quality, coding, missing data, model specification, influential observations, uncertainty, and whether the constructs were operationalized as intended.
Check theoretical scope Return to the theory and determine whether the proposition assumes voluntary adoption, particular forms of support, or contextual conditions that differ from the present study.
Consider the context Suppose institutional “support” in this setting accompanies mandatory implementation requirements. Instructors may interpret intensive support as a signal that adoption is institutionally imposed rather than voluntary.
Limit the interpretation The study can report that the observed relationship differs from the predicted one and propose mandatory implementation as a possible contextual explanation. Unless the study directly tested that mechanism, it should not claim to have established why the reversal occurred.
Generate the next question A subsequent study could test whether perceived voluntariness moderates the relationship between institutional support and adoption intention.

The unexpected result has now become theoretically productive without being overinterpreted. The original hypothesis remains unsupported, the alternative explanation is identified as provisional, and a new testable proposition emerges.

05 · What Researchers Often Get Wrong

Common Mistakes When Findings Do Not Behave as Theory Expected

Misconception

If My Hypothesis Is Unsupported, Did the Study Fail?

No. The purpose of empirical research is not to guarantee confirmation. Credible evidence that fails to support a prediction can refine understanding, expose boundary conditions, challenge assumptions, or motivate better questions. The quality of the study depends on the rigor of the inquiry, not on whether the preferred result appeared.

Misconception

If the Result Is Non-Significant, Does That Prove the Theory Is Wrong?

No. A non-significant result can arise under many conditions and should be interpreted using effect estimates, uncertainty, design quality, measurement, statistical power where relevant, and the broader evidence base. Failure to reject a null hypothesis is not automatically evidence that a theoretical relationship does not exist.

Misconception

Should I Remove the Theory Because My Findings Do Not Support It?

Usually not simply for that reason. The disagreement itself may be central to the discussion. Removing the framework after seeing the results can obscure the prediction that the study actually evaluated.

Misconception

Can I Add a New Explanation to Make the Findings Fit?

You can develop theoretically informed post hoc explanations, but identify them as interpretations or hypotheses generated by the findings. Do not present them as though they had been specified before the analysis.

Misconception

Does One Contradictory Study Overturn an Established Theory?

Usually not. A single study may challenge a particular proposition under particular conditions, but broader theoretical conclusions require consideration of study quality, replication, converging evidence, scope conditions, and alternative explanations.

06 · What This Means for You

Treat the Discrepancy as Something to Diagnose Before You Explain It

When findings diverge from theoretical expectations, resist both convenient reactions: forcing the evidence back into the framework or immediately announcing that the framework has failed.

A simple diagnostic framework

If the finding differs from the hypothesis
Report the discrepancy directly before proposing explanations.
If the theory may not actually predict what you assumed
Return to the original theoretical sources and verify the proposition and its scope conditions.
If measurement, data quality, or analysis could plausibly explain the result
Investigate those possibilities transparently without selectively searching until the preferred result appears.
If the discrepancy appears context-dependent
Discuss the possible boundary condition while distinguishing it from a mechanism the study has actually demonstrated.
If the unexpected pattern suggests a new explanation
Frame it as a hypothesis or interpretation generated by the findings and identify what future evidence would test it.
If credible evidence repeatedly challenges the same theoretical proposition
Consider whether refinement, narrower scope conditions, or an alternative theoretical explanation is warranted.

This process keeps theory and evidence in a productive relationship. Theory tells you what you had reason to expect; evidence constrains what you can continue to claim.

If repeated conflicts reveal that the framework no longer supports the question you are genuinely investigating, the issue may eventually require revisiting the conceptual foundation of the study rather than patching later methodological components.

07 · A Quick Checklist

Before You Claim That Your Evidence Contradicts the Theory, Check:

When findings differ from theoretical expectations, check:
Verify from the original or authoritative theoretical source what relationship was actually predicted and under what conditions.
State precisely how the observed result differs from the prediction without exaggerating what the evidence establishes.
Examine measurement validity, coding, missing data, model assumptions, uncertainty, and other relevant data-quality issues.
Check whether the design and analysis genuinely evaluated the theoretical proposition you claim to have tested.
Consider plausible contextual or population-specific boundary conditions.
Distinguish explanations demonstrated by your evidence from explanations that remain theoretically plausible.
Label explanations developed after seeing the results as post hoc interpretations or new hypotheses rather than prior predictions.
Limit conclusions to the theoretical proposition and conditions your study actually examined rather than declaring an entire theory confirmed or disproved.
08 · Frequently Asked Questions

Frequently Asked Questions About Theory and Unexpected Findings

Does an unsupported hypothesis mean the theory is wrong?

Not automatically. The result may bear on a particular theoretical proposition, but its interpretation also depends on measurement, design, analysis, uncertainty, population, context, and the scope of the theory. Broader theoretical conclusions usually require evidence beyond a single study.

Should I change my conceptual framework after seeing the results?

You may propose a revised framework as an interpretation or product of the findings when justified, but preserve the distinction between the framework that guided the original study and a framework developed afterward. Otherwise, readers cannot tell what was predicted and what was learned from the evidence.

Can unexpected findings be more important than expected findings?

They can be theoretically informative, particularly when they reveal previously unrecognized conditions, mechanisms, or limitations. Their importance depends on the credibility of the evidence and whether the unexpected pattern can be explained and subsequently examined rather than on unexpectedness itself.

What if my result is significant but in the opposite direction?

Report that the directional hypothesis was not supported and describe the observed estimate with its uncertainty. Then examine measurement, coding, model specification, context, theoretical assumptions, and competing explanations before interpreting the reversal.

What if the result is not statistically significant?

A non-significant result should not automatically be translated into “no effect” or “the theory is false.” Consider the estimated effect, uncertainty, design, measurement quality, sample information, and the inferential approach used before deciding what the result implies.

Can I develop a new hypothesis from an unexpected finding?

Yes. Unexpected evidence can be an excellent source of new hypotheses. Make clear that the new hypothesis was generated from the observed result and, ideally, evaluate it with new evidence rather than treating the original dataset as independent confirmation.

Should theory or data take priority when they disagree?

Neither should receive automatic priority. Theory provides structured expectations; empirical evidence provides observations interpreted through measurement, design, and analysis. Investigate the discrepancy and determine what conclusions the combined theoretical and empirical record can actually support.

09 · The Bottom Line

Unexpected Evidence Should Challenge Your Reasoning, Not Your Commitment to Reporting It

The Bottom Line

When evidence differs from what theory predicts, report the discrepancy honestly and investigate whether it reflects uncertainty, measurement, analysis, context, methodological limitations, theoretical boundary conditions, or a genuine weakness in the theoretical proposition.

Do not force the evidence to confirm the framework, but do not declare a theory disproved because one result behaved unexpectedly. The most useful outcome is often a more precise statement of what the theory appears to explain, where its limits may lie, and what evidence should be collected next.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes