Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Do You Justify a Replication Without Pretending It Is Completely Novel?

A replication does not need a completely new research question to make a contribution. A strong justification explains which existing claim remains uncertain, why resolving that uncertainty matters, and how the new study provides evidence the literature does not yet have.

502
How to Justify a Replication Study Guide 502 of 533
01 · The Question

How Can a Replication Be Original If the Question Has Already Been Asked?

You want to replicate an existing study, but sooner or later someone asks the familiar question: "What is new about your research?"

That question can push researchers into an awkward position. You might be tempted to emphasize a different population, add variables you did not originally need, describe a new location as an unexplored context, or quietly make the replication sound as though nobody has investigated the underlying question before.

You do not need to do that.

A replication can make a legitimate research contribution precisely because previous research already exists. Its rationale comes from the uncertainty that remains around an existing claim and the new evidence your study can contribute to evaluating that claim. The challenge is to explain that contribution without confusing novelty of question with novelty of evidence.

02 · The Short Answer

Justify the New Evidence, Not a Fictional New Question

In Brief

Justify a replication by identifying the prior claim you are testing, showing what important uncertainty remains in the existing evidence, explaining why reducing that uncertainty matters, and demonstrating how your new study can provide an informative independent test.

You do not need to claim that the research question has never been asked. The contribution may instead lie in testing whether a finding recurs, estimating it more precisely, examining its generalizability, confronting conflicting evidence, testing an important boundary, or providing stronger evidence where the existing evidence is limited.

03 · What You Need to Know

A Replication Has a Different Kind of Contribution From a Completely New Study

Novelty Is Not the Only Basis for Research Contribution

Many researchers learn to justify a study by finding something that previous research has not done. That strategy makes sense when the proposed contribution genuinely concerns a new question, construct, mechanism, population, method, or phenomenon.

It becomes problematic when applied mechanically to replication.

A replication begins with prior research by design. If you are testing an existing claim again, pretending that the question itself is unprecedented misrepresents the purpose of the study.

Nosek and Errington argue that replication should be understood as confronting an existing claim with new evidence. Under their definition, a study functions as a replication when its possible outcomes would provide diagnostic evidence about a claim from prior research. A result consistent with the claim would increase confidence in it, while an inconsistent result would decrease confidence in it.

That provides a straightforward answer to the novelty problem:

The question may already exist, but the evidence does not.

Your contribution is the new evidential test and what it adds to the cumulative assessment of the claim.

Start With the Claim, Not With "No Study Has..."

A strong replication rationale usually begins by identifying what previous research has led researchers to believe.

For example:

"Previous research reports that intervention X improves outcome Y."

That establishes the claim. The next step is not automatically:

"However, no study has examined intervention X at University Z."

Instead, ask what remains unresolved about the claim itself.

Perhaps only one study has tested it. Perhaps the original estimate is imprecise. Perhaps independent evidence is scarce. Perhaps subsequent studies conflict. Perhaps the finding is widely used despite being supported by a narrow population. Perhaps the original design has an important limitation. Perhaps the practical consequences of relying on the finding are substantial.

Those are potential sources of replication rationale because they identify uncertainty in the evidence rather than merely an empty location in the literature.

Novelty gap Something has not previously been studied, measured, compared, or tested.
Replication need An existing claim requires additional evidence because an important uncertainty about its reliability, magnitude, generality, or evidential basis remains.

A replication can have both. It does not need both.

The Contribution Can Be Independent Evidence

Sometimes the strongest justification is remarkably simple: an important claim has little independent evidence.

Suppose an influential study reports a substantial effect and later researchers routinely cite that finding, but most subsequent papers assume the effect rather than test it directly. The claim may have become familiar without becoming well replicated.

An independent study can therefore contribute evidence that the literature currently lacks.

Independence matters because a new research team, sample, setting, and implementation can expose the claim to sources of variation not represented in the original work. Brandt and colleagues describe close replication as an important component of cumulative science and recommend careful recreation of the original study, adequate statistical power, attention to differences between studies, and preregistration as elements of convincing replication practice.

The justification is not that the original researchers should be distrusted. It is that scientific credibility grows through evidence that does not depend entirely on one dataset or one implementation.

The Contribution Can Be Greater Precision

An original study may support a claim while leaving substantial uncertainty about the magnitude of the effect.

Suppose a small experiment reports that an intervention produces a large improvement, but the estimate has a wide confidence interval. The literature may reasonably ask whether the effect is genuinely large, modest, or perhaps too uncertain for a consequential decision.

A sufficiently informative replication can contribute by estimating the effect more precisely.

This is a different rationale from simply asking whether the effect exists. In many applied contexts, magnitude matters at least as much as direction. An intervention with a very small average benefit and one with a large benefit can have quite different implications for implementation, cost, and policy.

A strong rationale therefore might say that the replication is needed to improve confidence in the plausible magnitude of an important effect, not merely to obtain another statistically significant result.

The Contribution Can Be Testing Generalizability

An original finding may be well supported under the conditions in which it was studied but uncertain beyond them.

Suppose a relationship has been demonstrated repeatedly among university students from similar institutions. Your population differs in a way that theory or practice suggests could matter.

The replication can then ask whether the claim continues to receive support under that meaningful variation.

Nosek and Errington note that successful replication provides evidence of generalizability across conditions that inevitably differ between studies. Deliberately introducing a relevant population or contextual difference can therefore make the scope of the claim itself the object of investigation.

The justification should explain why the new condition matters. Simply saying that the study has never been conducted in your institution, city, or country is usually insufficient unless that setting represents a meaningful scientific or practical uncertainty.

The distinction becomes particularly important when deciding what a population change actually contributes to a replication.

The Contribution Can Be Resolving Conflicting Evidence

Replication is not needed only when evidence is scarce. It can also be useful when evidence exists but does not agree.

Suppose one study reports a substantial effect, another reports a much smaller effect, and a third produces little evidence of the expected relationship. The literature now contains an unresolved empirical problem.

A new replication can contribute if it is designed to help clarify that disagreement.

Simply adding another small study may not be enough. A stronger rationale identifies plausible reasons for the inconsistency and explains how the proposed design provides a more informative test. Perhaps previous studies differed in statistical precision, measurement quality, implementation, population, or another theoretically meaningful condition.

The contribution is then not "nobody has done this before." It is "the existing evidence does not yet support a sufficiently clear conclusion, and this study is designed to reduce that uncertainty."

The Contribution Can Be a Stronger Test of a Weakly Supported Claim

Sometimes the original study is methodologically limited but its underlying question matters.

Perhaps the sample is too small for useful precision. Perhaps the measurement is questionable. Perhaps procedures are insufficiently documented. Perhaps the analysis allows more confidence than the design warrants.

A replication can contribute by subjecting the important claim to a stronger test.

This should be framed carefully. The rationale is not that the original study was "bad" and your study will correct it. Instead, explain which limitation leaves uncertainty about the claim and how the new design provides more informative evidence.

That distinction is central when considering whether a weak study is actually worth replicating. Methodological weakness creates uncertainty, but the underlying claim still needs to matter.

The Contribution Can Be Testing a Finding That Matters

A replication can also be justified by the consequences of being wrong.

If a claim influences an educational intervention, clinical practice, professional recommendation, organizational policy, theoretical framework, or subsequent research program, uncertainty about that claim may have substantial downstream consequences.

In such cases, another independent test may be useful even if the finding is not particularly famous.

This is why citation count and journal prestige are weak substitutes for a replication rationale. A highly visible finding may already have extensive independent support, while a less celebrated claim may quietly underpin substantial work in a specialized field.

The better target is the claim for which reducing uncertainty would matter. That is also why field relevance can be more important than fame when choosing what to replicate.

Do Not Manufacture Novelty by Adding a Variable

One common response to the novelty problem is to turn a clean replication into a more complicated study.

The researcher begins with an existing X-Y relationship and thinks:

"I need something new, so I will add Z."

Now Z becomes a moderator, mediator, predictor, control variable, or additional outcome, sometimes with little theoretical reason beyond making the project appear different from the original.

That is not a strong justification.

If Z addresses an important additional question, the project may legitimately combine replication and extension. But the extension should earn its place scientifically. It should not function as camouflage for a replication that the researcher feels embarrassed to describe honestly.

If a new variable creates an additional substantive claim, be explicit that the relevant component is an extension of the original research.

Do Not Manufacture Novelty From Geography Either

Another familiar rationale is:

"This relationship has been studied elsewhere, but not in our country."

That statement may be true. It is not yet a justification.

Ask what the new context allows you to learn. Does the educational system differ in a theoretically relevant way? Does the population have characteristics that could plausibly alter the phenomenon? Is local evidence needed before an intervention is adopted? Does previous evidence come from a narrow cultural or socioeconomic context?

If so, the contextual replication can be justified through generalizability or practical relevance.

If not, the absence of a local study is merely an empty cell in the literature.

Watch Out

"No previous study has examined this topic in our institution" is not automatically a research gap worth filling. Explain what uncertainty the new setting resolves or what consequential decision requires local evidence.

You Do Not Need to Pretend That the Original Study Was Inadequate

Replication rationales sometimes swing too far in the opposite direction. To justify another study, researchers portray the original evidence as defective even when it was reasonably strong.

That is unnecessary.

A carefully conducted study can still merit replication because one study cannot establish every aspect of a claim's reliability, precision, or generality. The rationale can acknowledge the strengths of the original research while explaining what one study cannot determine by itself.

For example:

"The original study provides evidence supporting X under Y conditions. However, independent evidence remains limited, leaving uncertainty about whether the finding recurs in new data."

That is a stronger scholarly position than searching for a minor flaw merely to create a problem that your study can solve.

Previous Successful Replication Does Not Automatically Eliminate the Rationale

What if someone has already replicated the finding successfully?

Then your rationale must reflect the evidence that now exists.

You cannot justify the study as though the claim has never received independent support. Instead, ask what remains unresolved after the previous replication. Perhaps both studies used similar populations. Perhaps effect-size estimates remain imprecise. Perhaps the claim has important consequences that justify additional independent verification.

Alternatively, perhaps very little important uncertainty remains. In that case, another nearly identical replication may have weak incremental value.

This is why a previously successful replication changes the rationale for the next one rather than automatically ending replication forever.

A Replication Rationale Should Work Regardless of the Result

This is one of the strongest tests of your justification.

Imagine that the replication produces evidence consistent with the original finding. Would that result contribute useful information?

Now imagine that it produces evidence inconsistent with the original finding. Would that also contribute useful information?

If the answer is yes in both cases, your rationale is probably centered on evidence rather than outcome.

If the study seems valuable only if it produces a surprising non-replication, you may actually be justifying a hoped-for result rather than the research itself.

Nosek and Errington's definition makes this symmetry central: possible outcomes should be diagnostic of the prior claim. A replication designed this way has a contribution before the data are known.

That principle also explains why a replication can remain valuable when the original result does not recur.

The Introduction Should Move From Existing Claim to Remaining Uncertainty

A replication introduction does not need elaborate rhetorical machinery. Its core logic can be quite direct.

1. Establish the claim Explain what previous research reports and why the claim matters.
2. Describe the current evidence Identify the original study and relevant subsequent tests, syntheses, or replications.
3. Identify the remaining uncertainty Explain what the available evidence still does not establish with sufficient confidence.
4. Explain why the uncertainty matters Connect it to theory, subsequent research, practice, policy, generalizability, or another consequential issue.
5. Show how the replication addresses it Explain why the proposed design can provide informative new evidence about the claim.

This structure avoids both extremes. It does not pretend the literature is empty, and it does not reduce the rationale to "replication is important."

Be Precise About What Is New

Replication is not devoid of novelty. It simply locates novelty differently.

Your new study may provide:

  • a new independent dataset;
  • a new estimate of an existing effect;
  • greater statistical precision;
  • evidence from a theoretically meaningful population;
  • evidence under a relevant new condition;
  • a test using a defensible alternative operationalization;
  • a more transparent or rigorous implementation; or
  • evidence capable of resolving disagreement among previous studies.

Those are legitimate contributions when they matter to the claim.

The key is not to inflate them. A new dataset is genuinely new evidence, but that does not mean every new dataset is important. A new population is empirically new, but that does not automatically establish a meaningful generalizability test. Greater precision is useful only if the original uncertainty matters.

State exactly what your study contributes and stop there. Academic writing occasionally improves when the contribution is allowed to be exactly as large as it actually is.

Use the Right Language for Replication

The wording of a replication rationale should reflect cumulative rather than replacement science.

Avoid Overclaiming Prefer More Precise Framing
No study has investigated X. Existing evidence for X remains limited to a small number of independent tests.
This study is the first to examine X in our university. This study tests whether the reported relationship is observed in a population relevant to the conditions under which the claim is expected to apply.
The original study needs to be validated. An independent replication can provide additional evidence about the reliability or generalizability of the reported finding.
The original study was weak. Specific limitations of the existing evidence leave uncertainty about the magnitude or reliability of the reported effect.
This replication will confirm the original result. The replication will provide new evidence for evaluating the prior claim.
The study is novel because we added another variable. The study separately tests the original claim and an additional prespecified extension concerning the new variable.

Notice that the stronger language is not weaker in substance. It is more specific about what the evidence can actually establish.

Your Methods Are Part of the Justification

A compelling research gap cannot rescue an uninformative replication design.

If you argue that the literature needs a more precise estimate, your sample and analysis should be capable of providing it. If the rationale concerns generalizability, the population difference should be relevant to that question. If the original evidence is methodologically limited, your study should address the limitation without changing so much that it no longer informs the original claim.

Brandt and colleagues' Replication Recipe emphasizes features such as faithful recreation of the original study, adequate statistical power, attention to contextual differences, and preregistration when designing convincing close replications.

The exact requirements vary with the research design and field, but the general principle is stable: the methods must be capable of resolving the uncertainty used to justify the study.

The Strongest Rationale Often Fits Into One Sentence

Once you understand the logic, you should be able to summarize the justification concisely:

Although previous research reports [claim], [specific uncertainty] remains because [state of evidence]; resolving this uncertainty matters because [consequence], and the present replication provides [type of new evidence] to evaluate the claim.

This is not a sentence that must be copied mechanically into every paper. It is a diagnostic template. If you cannot fill its components with defensible content, the replication rationale may not yet be clear.

04 · A Practical Example

Turning "This Has Not Been Done Here" Into a Real Replication Rationale

Hypothetical Example

Replicating an AI-Assisted Feedback Effect

Suppose a published experiment reports that AI-assisted formative feedback improves university students' writing performance compared with conventional written feedback. You want to conduct a replication in another higher education context.

Weak rationale No previous study has replicated this research at our university, making the present study novel.
Start with the claim Existing research reports that AI-assisted formative feedback can improve students' writing performance relative to conventional feedback.
Identify the uncertainty Direct independent evidence remains limited, and the available studies involve a relatively narrow range of higher education contexts.
Explain why it matters Institutions are considering the use of AI-supported feedback, so the reliability and plausible generalizability of the reported benefit matter for both research and implementation decisions.
State the contribution The new study provides an independent test of the reported effect using an appropriately comparable intervention and outcome in a higher education population that broadens the conditions represented in the existing evidence.

The stronger rationale does not pretend the research question is new. In fact, it depends on acknowledging the earlier research accurately.

It also avoids claiming that the new setting is inherently important. The setting matters only insofar as it contributes useful evidence about the scope of the claim or supports a consequential local decision.

If several rigorous independent studies had already established the effect across similar and different contexts, this rationale would need to change. Another replication cannot be justified indefinitely by repeating the same statement about limited evidence after the evidence is no longer limited.

05 · What Researchers Often Get Wrong

Common Mistakes When Justifying a Replication

Misconception

Does a Replication Need a Completely New Research Gap?

No. A replication can be justified by uncertainty surrounding an existing claim. Its contribution may be independent evidence, greater precision, a meaningful test of generalizability, resolution of conflicting findings, or a stronger test of a consequential claim.

Misconception

Do I Need to Say That Nobody Has Done the Study in My Country?

No. Use geography only when the new context matters to the scientific or practical question. A new country can provide valuable evidence about generalizability, but the geographical difference should be connected to a plausible source of variation or a consequential need for local evidence.

Misconception

Should I Add Variables So Reviewers See Something New?

Not merely for novelty. Additional variables should address justified questions. If they introduce new hypotheses, describe those components as extensions rather than allowing them to obscure the replication objective.

Misconception

Do I Have to Criticize the Original Study to Justify Replicating It?

No. A strong original study can still leave uncertainty because one study cannot establish every aspect of reliability, precision, or generalizability. Acknowledge what the original evidence supports and identify specifically what remains unresolved.

Misconception

Is "Replication Is Important" Enough of a Rationale?

No. That explains why replication matters in science generally, not why this particular claim needs this particular replication. Identify the claim, remaining uncertainty, consequences of that uncertainty, and the evidence your study can add.

Misconception

Should I Promise That My Replication Will Validate the Original Study?

No. The outcome is not known in advance, and replication should not be framed as a procedure for certifying earlier research. State that the study will provide additional evidence for evaluating the claim, with interpretation depending on the results and their uncertainty.

06 · What This Means for You

Build the Rationale Around the Uncertainty Your Study Can Reduce

Before writing the introduction, complete four tasks. Define the prior claim. Assess the current evidence. Identify the uncertainty that remains. Explain why resolving that uncertainty matters.

Only then should you describe what your replication adds.

A simple decision framework

If an important claim has little independent evidence
Justify the replication as an independent test that can strengthen or weaken confidence in the existing claim.
If the original effect estimate is too uncertain for an important conclusion
Justify a sufficiently informative replication as a way to improve evidence about the plausible magnitude of the effect.
If previous evidence comes from a narrow set of relevant conditions
Justify the replication through a specific question about generalizability rather than merely saying the new setting has not been studied.
If previous studies disagree
Explain how the proposed replication can clarify the inconsistency or distinguish plausible explanations.
If the existing study is methodologically limited but the claim matters
Explain which limitation leaves the claim uncertain and how the new design provides a stronger test.
If substantial high-quality evidence already addresses the relevant uncertainty
Reconsider whether another similar replication is the best use of research resources or whether a different question would contribute more.

When writing the rationale, resist inflated novelty language. Terms such as "first," "unique," and "unprecedented" should be used only when they are factually defensible and actually relevant to the contribution.

A replication can instead be described as an independent test, a test of generalizability, a more precise evaluation, a test under a theoretically meaningful condition, or a stronger test of an uncertain claim, depending on what the study genuinely does.

And if your best justification is simply that the original finding deserves another independent test because it matters and remains uncertain, say that. Research writing does not become more scholarly by hiding the actual reason for conducting the research behind a ceremonial "novel gap."

07 · A Quick Checklist

Before Finalizing Your Replication Rationale

Before writing that your replication is justified, check:
State the specific prior claim your study is intended to test.
Search for existing direct replications, conceptual tests, systematic reviews, meta-analyses, and other relevant evidence before claiming that uncertainty remains.
Identify exactly what remains uncertain: reliability, effect magnitude, generalizability, boundary conditions, conflicting findings, or another evidential issue.
Explain why resolving that particular uncertainty matters to theory, subsequent research, practice, policy, or another consequential decision.
Show how the proposed design can actually reduce the uncertainty used to justify the replication.
Avoid treating a new institution, city, country, or demographic group as inherently important without explaining why the difference matters.
Keep replication objectives separate from any additional extension hypotheses introduced by new variables or analyses.
Ask whether both a result consistent with the original finding and an inconsistent result would provide useful evidence.
Describe the contribution accurately without claiming that an existing research question is completely novel.
08 · Frequently Asked Questions

Questions About Writing a Replication Study Rationale

What is the research gap in a replication study?

The gap is often an evidential uncertainty rather than a completely unanswered question. The existing claim may lack independent support, precise estimation, evidence across relevant conditions, resolution of conflicting findings, or a sufficiently rigorous test. State the uncertainty specifically rather than forcing the study into a novelty-gap formula.

Can I say that my replication study is novel?

Only in the specific respects that are genuinely new. The dataset is new, and the study may test a new relevant condition or provide a new independent estimate. Avoid implying that the underlying research question is new when previous research has already asked it.

How do I justify replicating a study in another country?

Explain why the new context is relevant to the claim. The rationale might concern cultural, institutional, linguistic, socioeconomic, technological, or other theoretically meaningful differences, or a consequential need for local evidence. "It has not been studied here" is an observation, not a complete justification.

How do I justify replicating a study that was already replicated?

Acknowledge the existing replication and identify what uncertainty remains after it. Another study may address precision, independence, generalizability, an important untested condition, or a high-stakes claim. If little relevant uncertainty remains, another closely similar replication may have limited incremental value.

Can the replication itself be the contribution?

Yes, when another informative test of the claim is valuable. But explain why. The word "replication" does not automatically establish importance. Show what uncertainty the new evidence reduces and why reducing it matters.

Should I add a new variable to make the replication more original?

Only if the variable addresses a meaningful additional question. If it introduces a new substantive hypothesis, distinguish that extension from the replication component. Adding variables merely to create the appearance of novelty can weaken rather than strengthen the study's rationale.

How should I state the purpose of a replication study?

State the prior claim and the specific evidential uncertainty your study addresses. For example, the purpose may be to provide an independent test of a reported effect, estimate it more precisely, examine whether it generalizes to a theoretically relevant population, or clarify inconsistent previous findings.

What if my adviser or reviewer asks, "What's new?"

Answer in terms of the new evidence and why it matters. Explain what the literature currently supports, what remains uncertain, and what your study adds to that evidence. You do not need to claim a completely new question when the scientific contribution is a more credible, precise, independent, or generalizable test of an existing claim.

09 · The Bottom Line

You Do Not Need to Invent Novelty to Make Replication Valuable

The Bottom Line

Justify a replication by showing that an important claim still contains an important uncertainty and that your study can provide new evidence capable of reducing that uncertainty.

The contribution does not have to be a research question nobody has asked before. It may be independent evidence, greater precision, a test of generalizability, clarification of conflicting findings, or a stronger test of a consequential claim. State that contribution accurately. A replication becomes more convincing, not less, when it is honest about what has already been studied and precise about what still needs to be known.

10 · Sources and Further Reading

Sources on Justifying and Designing Replication Studies

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes