Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Can You Deviate From a Preregistered Study Without Doing Something Wrong?

A deviation from preregistration is not automatically a research mistake. What matters is why the change occurred, when it was made, whether the results influenced it, and whether it is reported transparently.

199
Deviating From a Preregistered Study Guide 199 of 217
01 · The Question

If You Deviate From Your Preregistration, Have You Undermined the Study?

You preregistered your research plan carefully. Then something happens that the plan did not anticipate.

Perhaps recruitment falls short. A measure performs poorly. The statistical model you specified is inappropriate for the observed data structure. An exclusion rule turns out to contain an error. Or an unexpected result suggests an analysis that would be scientifically irresponsible to ignore.

You now face an uncomfortable choice: follow the preregistration even though you have a reason not to, or deviate and worry that the study is no longer legitimately preregistered.

That is a false choice. Preregistration is intended to make research decisions more transparent, not to make researchers obedient to decisions that later prove mistaken, infeasible, or incomplete.

02 · The Short Answer

A Deviation Is Not Automatically a Research Error

In Brief

Yes. You can deviate from a preregistered study without doing something wrong. A deviation may be methodologically necessary, practically unavoidable, ethically required, or scientifically useful; what matters is why and when it occurred, whether knowledge of the results influenced the decision, and how transparently the difference is reported.

Disclosure does not make every deviation methodologically harmless, but deviation itself is not misconduct or evidence that preregistration failed. The important distinction is between changing a plan transparently for defensible reasons and changing it in response to results while concealing that history.

03 · What You Need to Know

How to Tell a Defensible Deviation From a Problematic One

Preregistration Was Never Meant to Make Researchers Follow Known Mistakes

A preregistration records what researchers intended to do before the relevant results were known. That timing can make it easier to distinguish advance decisions from choices made after researchers learned something from the data.

But advance decisions are not automatically correct decisions.

You can preregister an inappropriate statistical model. You can miscalculate a target sample size. You can misunderstand how a variable is coded. You can specify an exclusion rule that later proves impossible to implement. You can simply make a mistake.

Nosek and colleagues explicitly acknowledge that deviations can improve research when researchers discover errors in their original plans or learn that a better approach is available. The objective is therefore not perfect correspondence between preregistration and publication.

This is why preregistration does not mean that nothing can change.

Some Deviations Improve the Study

Imagine discovering that the statistical analysis you preregistered rests on an assumption that is clearly inappropriate for the data structure. You now know that another method provides a more defensible analysis.

Following the original method merely because it was preregistered would preserve adherence at the expense of methodological quality.

A better approach may be to use the more appropriate analysis and explain the deviation. Depending on the circumstances, reporting the preregistered analysis as well may help readers understand the effect of the change.

The same logic applies to corrections of coding errors, mistaken exclusion rules, inappropriate measurement procedures, and other problems discovered after registration.

Deviation to improve validity The original plan is changed because new information reveals an error, methodological problem, or more defensible approach.
Deviation to improve the result The plan is changed because another choice produces a more favorable, statistically significant, theoretically convenient, or otherwise preferred outcome.

The first can be entirely defensible. The second deserves considerably more scrutiny, particularly when the result influenced the choice and that influence is not disclosed.

Some Deviations Are Practically Unavoidable

Research plans interact with the world, and the world has not read your preregistration.

A participating site may withdraw. Recruitment may stop before the planned sample is reached. Equipment may fail. A software service may change. A planned dataset may become inaccessible. A researcher may leave the project. An intervention may need to move online.

These events can require changes even when the original plan was methodologically sound.

The existence of such a deviation says little by itself about research quality. The relevant questions concern what changed, why it changed, and whether the modification affects the study's scope, comparability, precision, or interpretation.

Ethical Reasons Can Require a Deviation

Ethical obligations take precedence over adherence to a preregistered procedure.

If a procedure creates an unforeseen risk to participants, new information affects informed consent, a privacy problem emerges, or an ethics body requires a modification, researchers should not continue the original procedure merely to preserve preregistration fidelity.

Such changes may also require formal approval under institutional or regulatory procedures. Those requirements depend on the research context and should be handled through the relevant ethics or oversight process.

Preregistration does not override those obligations.

Timing Changes How a Deviation Should Be Interpreted

Suppose two researchers make exactly the same change to a statistical model.

The first discovers an error in the preregistration before collecting any data. The second compares several analyses after seeing the primary result and selects a different model because it produces a more favorable finding.

The final analyses may be identical, but the decision processes are not.

This is why the timing of a deviation matters. Researchers should consider what information was available when the revised decision was made.

Situation Result knowledge Typical interpretive concern
Error corrected before relevant data are collected Relevant outcome unknown The correction was not selected because of the eventual result.
Procedure changed during data collection for logistical reasons Relevant outcome may still be unknown The change may affect implementation, comparability, or generalizability.
Analysis changed after an assumption problem becomes visible Relevant data have been examined The change may be justified, but the decision is now data-informed.
Outcome or model changed after comparing which produces the preferred result Results known There is substantial risk of result-contingent selection.

A Data-Informed Deviation Is Not Automatically Wrong Either

The fact that a researcher has seen the data does not make every subsequent methodological decision improper.

Some problems can only become apparent after examining the data. A model may fail to converge. A distribution may make a planned procedure untenable. A measurement problem may become visible only during cleaning. An unexpected structure may require a different statistical treatment.

The appropriate response is not to pretend that the decision remained independent of the data. It is to disclose that the change was made after relevant information became available and explain the methodological reason.

Readers can then evaluate whether the revised analysis is persuasive and how strongly it should be interpreted as confirmatory.

Exploratory Analyses Are Not Illicit Deviations

Suppose your preregistered analysis is completed exactly as planned. You then notice an unexpected pattern and conduct several additional analyses to understand it.

You have gone beyond the preregistration, but that does not mean you have done something wrong.

Exploration is a legitimate part of research. The key is to distinguish those analyses from the ones specified prospectively. An analysis inspired by an observed pattern should not be presented as though it were an advance test of a hypothesis that existed before the pattern was seen.

This preserves the distinction between exploratory and confirmatory research without treating exploration as a methodological embarrassment.

A Deviation Can Affect Only Part of the Study

Another common mistake is to treat preregistration as all-or-nothing.

Imagine that the research question, hypothesis, sample, primary outcome, and exclusion criteria all remain as preregistered, but the primary statistical model changes for a defensible reason.

It would be misleading to claim perfect adherence. It would also be unnecessarily crude to say that nothing about the study remained preregistered.

The more informative approach is component-specific: identify which parts followed the plan and which did not.

Willroth and Atherton describe preregistration deviations as discrepancies between the preregistration and the final article and argue for transparent reporting that allows readers to evaluate those differences rather than assuming that any deviation automatically invalidates the research.

Some Deviations Have Greater Inferential Consequences Than Others

Moving a laboratory session from one room to another is not equivalent to changing the primary outcome after seeing which outcome produces the strongest effect.

Changing a recruitment advertisement may have different consequences from changing an exclusion criterion after observing which cases weaken the result. Correcting a typographical error in an analysis script is different from testing several models and reporting only the statistically significant one.

When evaluating a deviation, ask:

  • Could the change alter the study's primary conclusion?
  • Was the decision influenced by knowledge of the result?
  • Did it introduce additional analytical flexibility?
  • Did it change the hypothesis, primary outcome, analyzed sample, or inferential procedure?
  • Would a reasonable reader interpret the evidence differently if they knew about the change?

The more strongly the answer points toward consequential influence, the more important explicit reporting becomes.

Disclosure Is Necessary, but It Does Not Make Every Decision Sound

Transparency should not be confused with methodological absolution.

A researcher could openly state that the primary outcome was changed after seeing that another outcome produced a statistically significant result. The disclosure is better than concealment, but it does not restore the revised analysis to the evidential status of an independently prespecified primary test.

Likewise, reporting a poorly justified deviation does not make the methodological problem disappear.

Transparency gives readers the information needed to evaluate the change. It does not determine what their evaluation should be.

Watch Out

“We disclosed the deviation” and “the deviation does not affect the inference” are separate claims. Report the change transparently, then consider whether it alters the strength, scope, or confirmatory status of the conclusion.

Registered Reports May Impose Additional Requirements

When the study is being conducted as a Registered Report, deviations involve an additional consideration: the Stage 1 plan has undergone prospective journal review and may have received in-principle acceptance.

Publishers and journals can specify procedures for handling changes. For example, current Elsevier Registered Reports guidance advises authors to consult the handling editor before deviating from proposed materials and methods.

Researchers should therefore verify the target journal's current policy rather than assuming that the same amendment process applies to ordinary preregistration and Registered Reports.

This is one of the practical differences between preregistration and Registered Reports.

Good Preregistration Makes Deviations Interpretable, Not Impossible

A preregistration that is sufficiently specific gives later deviations meaning. If the original plan simply says “appropriate analyses will be conducted,” almost any eventual analysis could be claimed as consistent with it.

Specificity therefore creates the possibility of identifying differences between intention and execution.

That can feel uncomfortable because deviations become visible. But visibility is part of the point.

A study with several transparently reported deviations may provide a more faithful research record than a supposedly flawless preregistered study whose registration was too vague to constrain anything consequential.

04 · A Practical Example

When Deviating Is More Defensible Than Following the Plan

Hypothetical Example

A Preregistered Analysis Turns Out to Be Inappropriate

A research team preregisters a study testing whether an educational intervention improves student performance. The primary outcome and hypothesis remain exactly as planned, but a problem appears during analysis.

Original plan The researchers specify the sample, primary outcome, exclusions, and statistical model before collecting the relevant data.
Problem discovered After data collection, they discover that the planned model does not adequately account for an important feature of the study's data structure.
Deviation They use a methodologically appropriate alternative rather than knowingly applying the unsuitable model.
Transparency The manuscript identifies the preregistered analysis, explains why it was changed, states that the decision occurred after examination of the data structure, and reports an appropriate comparison or sensitivity analysis where informative.
Interpretation The researchers do not claim perfect adherence. They explain why the revised analysis is preferable and allow readers to evaluate the consequences of the data-informed change.

The deviation is real. So is the methodological justification. Reporting both gives a more accurate account than either blindly following the original analysis or quietly replacing it.

05 · What Researchers Often Get Wrong

Misconceptions About Deviating From Preregistration

Misconception

Is Any Deviation Evidence of Bad Research Practice?

No. Deviations can result from errors, methodological improvements, practical constraints, ethical requirements, or unexpected scientific developments. The reason and consequences need to be evaluated rather than inferred from the mere existence of a change.

Misconception

Should I Follow a Bad Analysis Because I Preregistered It?

No. Preregistration does not turn an inappropriate method into an appropriate one. Use the defensible analysis, disclose the deviation, and consider reporting the originally planned analysis when doing so helps readers evaluate the change or is required by the publication venue.

Misconception

If I Deviate Once, Is the Whole Study No Longer Preregistered?

No. Adherence can be evaluated at the level of individual hypotheses, outcomes, exclusions, procedures, and analyses. A deviation in one component does not erase the prospective status of everything else.

Misconception

If I Explain a Deviation, Does It Become Confirmatory Again?

Not necessarily. Disclosure preserves transparency, but a decision made after examining the relevant result may still have different inferential implications from a decision fixed prospectively.

Misconception

Are Additional Analyses Violations of Preregistration?

No. Additional analyses can be scientifically useful. Distinguish analyses specified in advance from analyses motivated by the observed data rather than suppressing exploration.

06 · What This Means for You

Judge a Deviation by Its Reason, Timing, and Consequences

When you need to depart from a preregistration, resist two equally unhelpful reactions: “I am not allowed to change anything” and “anything is fine as long as I disclose it.”

A simple decision framework

If the preregistered decision contains an error
Correct it and record when the error was discovered and whether the relevant results were already known.
If the original procedure becomes infeasible or unethical
Use a defensible alternative and document the practical or ethical reason for the change.
If the observed data reveal that the planned analysis is inappropriate
Use the appropriate method, disclose that the revision was data-informed, and consider how this affects the confirmatory interpretation.
If you want to change something because another choice gives a more desirable result
Do not present the revised choice as though it were the preregistered test. Report the original plan and treat result-contingent alternatives with appropriate caution.
If an unexpected finding motivates a new analysis
Conduct it when scientifically useful and identify it as exploratory or otherwise post hoc rather than hiding the discovery.

Document deviations when they occur rather than reconstructing them during manuscript preparation. Record the original decision, the revised decision, the reason, the timing, and what relevant evidence had already been seen.

That information will later form the basis for reporting deviations transparently.

07 · A Quick Checklist

Before Departing From a Preregistered Decision

For each proposed deviation, check:
What exactly did the preregistration originally specify?
Why is the original decision now inappropriate, impossible, unethical, or scientifically incomplete?
When did you decide to deviate relative to data collection and analysis?
What relevant results or data features had you already examined when making the decision?
Could knowledge of the result have influenced which alternative you selected?
Does the deviation alter the primary hypothesis, outcome, sample, exclusion criteria, or analysis?
Would reporting both the preregistered and revised approaches help readers evaluate the effect of the change?
Have you recorded the deviation and rationale for transparent reporting later?
Does your journal, registry, funder, ethics body, or Registered Report protocol impose specific amendment requirements?
08 · Frequently Asked Questions

Frequently Asked Questions About Preregistration Deviations

Is deviating from a preregistration research misconduct?

No, not merely because a deviation occurred. Changes can be legitimate or necessary. Ethical and integrity concerns arise from the nature of the conduct, including deceptive or selective reporting, not from the simple fact that a research plan changed.

Can I change an analysis after seeing the data?

Yes, when there is a defensible reason. Make clear that the revised decision occurred after the relevant data were examined, explain why the change was necessary, and consider whether the resulting analysis should be interpreted differently from the original prospective test.

Should I report the preregistered analysis if I think it was wrong?

Sometimes reporting it can help readers understand the effect of the deviation, and some journals may require it. Do not treat a known inappropriate analysis as substantively preferred merely because it was preregistered. Explain why the revised method is more defensible.

Can I add an analysis that was not preregistered?

Yes. Additional analyses can be useful. Identify them as additional, exploratory, or post hoc where appropriate rather than implying that they were part of the original plan.

Does a deviation invalidate the preregistration?

Not automatically. The preregistration still documents the original plan. A deviation may actually demonstrate why that record is useful by revealing how the study developed after registration.

Are deviations more serious when they occur after seeing the results?

They generally require greater interpretive attention because the observed evidence could have influenced the decision. That does not make every post-result change improper, but the timing and rationale should be explicit.

Can I deviate from a Registered Report?

Potentially, but the journal's policy governs how changes to the Stage 1 plan are handled. Consequential modifications may need editorial consultation or approval. Verify the specific journal's current requirements before making the change.

09 · The Bottom Line

Deviation Is Not the Problem; Unexamined or Hidden Deviation Can Be

The Bottom Line

You can deviate from a preregistered study without doing something wrong. A deviation can correct an error, improve a method, respond to practical or ethical constraints, or pursue an unexpected scientific finding.

Evaluate the change by asking why it occurred, when it was made, what researchers already knew, and how it affects the eventual claim. Preserve the original plan and report consequential deviations transparently. Preregistration is most informative when it reveals the real research process, not when researchers pretend that the process never changed.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes