Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Should You Exclude a Study Just Because It Is Old?

A study should not usually be excluded merely because it is old. A publication-date restriction is most defensible when time itself has a meaningful relationship to the review question, evidence, technology, policy, or context.

123
Should You Exclude Old Studies? Guide 123 of 247
01 · The Question

How Old Is Too Old for a Literature Review?

Researchers are often told to use “recent literature.” Sometimes that becomes a rule of thumb: use studies from the last five years, exclude anything older than ten years, or replace older references whenever a newer paper exists.

That advice sounds sensible until you encounter an older study that is foundational to your topic, investigates exactly the population you need, or remains directly relevant to the question you are asking.

Should you exclude it simply because of its publication year?

Usually, no. The age of a study does not by itself tell you whether its evidence is relevant, methodologically credible, historically important, or applicable to your review. Publication date can be a legitimate eligibility criterion, but the cutoff should have a reason. “It is old” is a description, not yet a methodological justification.

02 · The Short Answer

Old Does Not Automatically Mean Irrelevant

In Brief

No. You should not normally exclude a study simply because it is old; use a publication-date restriction when there is a defensible reason why evidence before or after a particular point does not fit the review question.

A date boundary may make sense when a technology, intervention, policy, diagnostic definition, educational practice, historical event, or other material condition changed. Arbitrary cutoffs such as “the last five years” or “the last ten years” can exclude relevant evidence without improving the review.

03 · What You Need to Know

The Right Date Range Comes From the Question, Not From a Universal Rule

There Is No Universal Expiration Date for Research

Research papers do not become invalid on their fifth, tenth, or twentieth birthday.

Some evidence becomes less applicable as technologies, practices, institutions, populations, or policies change. Other research remains highly relevant for decades. Foundational theories, seminal experiments, established methodological papers, historical evidence, and studies of relatively stable phenomena may remain important long after publication.

The useful question is therefore not:

“How old is this study?”

It is:

“Has anything about the question, phenomenon, intervention, population, context, or evidence changed enough that this study no longer belongs in the body of evidence I am trying to examine?”

That shift turns publication year from a convenient filter into a substantive methodological decision.

Publication Date Can Be a Legitimate Eligibility Criterion

JBI recognizes publication date as one of the publication characteristics that may form part of a review's inclusion criteria. At the same time, JBI emphasizes that eligibility criteria should be explicit, reasonable, scientifically sound, and justified.

Cochrane similarly permits date restrictions but requires them to be justified. Its current guidance for intervention reviews advises that date restrictions in database searches should be used only when corresponding date restrictions exist in the study eligibility criteria and when there is a defensible reason relevant studies could only have been reported during a particular period.

The key distinction is therefore not between having and not having a date cutoff. It is between a question-driven date restriction and an arbitrary date restriction.

Question-driven date restriction The boundary corresponds to a meaningful feature of the phenomenon, intervention, policy, technology, historical period, or review objective.
Arbitrary date restriction The boundary is chosen primarily because a round number such as five or ten years seems convenient or because the researcher wants fewer papers to screen.

A Date Cutoff Makes Sense When the Phenomenon Did Not Yet Exist

The clearest justification occurs when studies before a certain date could not possibly examine the phenomenon defined by your review.

If you are reviewing experiences with a technology introduced in a particular period, searching decades before that technology existed may add little. The same reasoning can apply to a medication before approval, a diagnostic procedure before introduction, a policy before implementation, or an educational platform before deployment.

Cochrane gives a comparable example involving epinephrine autoinjectors: a search beginning with the year the first device was approved can be justified because earlier reports could not meet eligibility criteria concerning that intervention.

Notice the logic. The date itself is not what makes earlier studies irrelevant. The intervention's availability does.

A Major Change in Technology Can Create a Meaningful Boundary

Technology-intensive topics often require careful temporal reasoning because the same label can describe substantially different systems across time.

Consider a review of student experiences with generative AI feedback. Studies of automated feedback from 2005 may concern rule-based systems or other technologies that operate very differently from contemporary generative models.

You have at least two methodological options.

You could define eligibility conceptually, including only technologies that satisfy your definition of generative AI regardless of publication year. Alternatively, if a particular technological development creates a defensible historical starting point for the phenomenon, you might also use a date boundary.

The first approach is often more precise because it excludes studies for what technology they investigated rather than simply when they were published. A date restriction becomes useful when time closely corresponds to the substantive boundary you need.

Policy and Institutional Change Can Also Matter

Suppose you are reviewing an educational practice after implementation of a major national curriculum reform. Research conducted under the previous curriculum may describe a materially different institutional environment.

Or imagine a review of healthcare practice following introduction of a new diagnostic definition. Studies using an older definition may classify participants differently from contemporary research.

In these situations, a temporal boundary can be defensible because the context before and after the change is meaningfully different.

But be precise about what changed. “Research before 2015 is outdated” is much weaker than “the policy implemented in 2015 materially changed the practice being examined, so the review focuses on evidence generated under the post-implementation system.”

Historical Questions May Require Old Studies

Sometimes older evidence is not a nuisance to be filtered out. It is the evidence the question requires.

If you are examining how a concept developed, how professional practice changed, how an educational technology evolved, or how scholarly understanding shifted over time, restricting the review to recent publications could remove the very evidence needed to answer the question.

A review of the historical development of distance education that includes only papers from the last five years would tell you primarily how contemporary authors describe the past, not necessarily how the field itself developed.

The appropriate date range therefore depends on what kind of claim you intend to make.

Foundational Studies Do Not Stop Being Foundational Because They Are Old

Older studies may introduce theories, constructs, instruments, methods, or findings that later research builds upon. Replacing such a source with a recent article merely because the recent article cites it can weaken scholarly accuracy.

If you are discussing the origin of a theory, the original theoretical work may be the most appropriate source. If you are describing development of an instrument, the original validation paper may be necessary. If you are explaining a landmark discovery, a contemporary review cannot always substitute for the original study.

This does not mean old foundational studies should automatically enter the formal evidence synthesis. Their role depends on your review question and eligibility criteria.

An older paper may be indispensable contextual literature while remaining ineligible for the particular empirical synthesis you are conducting. This is the same distinction that matters when an important study falls outside the review's formal criteria.

“Use Sources From the Last Five Years” Is Not a Universal Research Rule

Students frequently encounter instructions to use sources published within the last five years. Such requirements may be imposed by an instructor, institution, assignment, journal, or discipline for a particular purpose. If that requirement applies to your work, you need to follow it.

But it should not be confused with a universal methodological principle governing literature reviews.

Recency may be particularly important in fast-changing areas such as emerging technologies, current policy, rapidly evolving clinical practice, or fields where evidence becomes obsolete quickly. Even then, older evidence may remain necessary for theory, historical context, methods, or comparison.

The methodological question is not whether five years is inherently better than six. It is whether the evidence remains appropriate for the claim you are making.

Do Not Use a Date Cutoff Merely to Reduce the Number of Search Results

A large search result can make a recent-date filter very tempting.

Suppose your search returns 4,000 records. Restricting the search to the last ten years reduces the result to 1,200. That certainly reduces the workload.

It does not, by itself, justify the restriction.

Cochrane specifically discourages arbitrary date limits for intervention reviews because eligible evidence can be lost. Date restrictions can also affect effect estimates in systematic reviews, so the decision is not always methodologically neutral.

Watch Out

Do not choose a publication cutoff solely because the unrestricted search produces more records than you want to screen. A workload problem and an eligibility rationale are different problems.

If Date Is an Eligibility Criterion, Align the Search With It Carefully

If studies before a particular date are genuinely ineligible, restricting database searches by date can improve efficiency. But the implementation deserves care.

Cochrane notes that databases contain different date fields, such as publication date, database entry date, creation date, and update date. Electronic and print versions of the same article can also carry different dates.

As a result, an apparently precise database filter may not correspond perfectly to the publication-date rule in your eligibility criteria. Searching a slightly wider period and applying the final criterion during screening can sometimes reduce the risk of missing eligible records near the boundary.

For an updated systematic review, the relevant date logic may be different again. Search updates are often organized around database entry dates or the date of the previous search rather than imposing a new publication-age criterion on the evidence.

Publication Date and Study Date Are Not the Same Thing

A paper published in 2025 might report data collected in 2016. A paper published in 2018 might analyze a long-running cohort that began decades earlier.

If your substantive concern is whether evidence reflects a particular technological, policy, or historical period, publication year may be only a proxy for the characteristic you actually care about.

Publication date When the report became publicly available.
Study or data-collection period When the underlying participants, interventions, exposures, or observations were actually studied.

Suppose a new educational policy took effect in 2020 and you want evidence about experiences under that policy. A paper published in 2022 using data collected in 2018 may not represent the post-policy context, while a publication-year cutoff of 2020 would incorrectly suggest that it does.

When time matters substantively, define the temporal characteristic that actually matters.

Newer Does Not Automatically Mean Better

A recent study may reflect the current context more closely, but publication year does not establish methodological quality.

A rigorous study from 2012 does not become methodologically weak because a poorly designed study appeared in 2025. Likewise, a recent article does not supersede an older study merely by existing.

Methodological quality and relevance require their own assessment. As with distinguishing relevance from study quality, recency should not become a shortcut for judgments it cannot support.

An Older Study May Be Less Applicable Without Being “Bad”

Temporal change can affect applicability even when the study itself was well conducted.

An excellent study of online learning conducted when most students relied on desktop computers and slow internet connections may not transfer perfectly to a contemporary environment dominated by smartphones, ubiquitous broadband, videoconferencing, and learning-management platforms.

The appropriate interpretation is not necessarily “old study equals bad study.” It may be:

“This study provides credible evidence about an earlier technological context, but its applicability to the current environment requires caution.”

That distinction preserves both methodological quality and contextual relevance.

Do Not Invent a Date Restriction After Seeing an Inconvenient Study

Suppose your protocol contains no publication-date restriction. During screening, you find an older study with findings that conflict with more recent evidence. You decide that studies before 2015 are probably too old to matter.

That is no longer simply a question about recency. You are considering a post hoc eligibility change after seeing the evidence.

For systematic reviews, eligibility criteria should generally be prespecified. If screening reveals a genuine need to revise them, the change should have a methodological justification and should not be driven by study findings.

If a temporal boundary genuinely becomes necessary after screening starts, follow the same safeguards involved in changing inclusion criteria during a review. Document the amendment and apply it consistently to all affected studies rather than selectively excluding inconvenient older evidence.

Different Review Types May Need Very Different Time Horizons

There is no single ideal date range because review purposes differ.

Review situation Possible temporal approach Reason
Emerging technology Potentially recent or technology-defined period Earlier studies may concern materially different technologies
Post-policy implementation review Begin around the relevant implementation period The policy creates a substantive contextual boundary
Historical development of a concept Include older and foundational literature Temporal development is part of the question
Established phenomenon with no obvious temporal break A broad date range may be appropriate Age alone may not affect relevance
Systematic review update Search from the previous search using an appropriate update strategy The goal is to identify newly available evidence without unnecessarily repeating completed work

The date range should therefore emerge from the phenomenon and the claims you intend to make, not from a generic expectation that a literature review should look recent.

04 · A Practical Example

Should a 2012 Study Be Included in a Review Conducted Today?

Hypothetical Example

Reviewing Student Experiences With Online Learning

Suppose a researcher is reviewing university students' experiences of online learning. A search retrieves a well-conducted qualitative study published in 2012. The researcher initially considers excluding it because it is more than a decade old.

Ask what the review actually covers If the question concerns university students' experiences of online learning generally, online education existed well before 2012. The publication year alone does not establish ineligibility.
Examine temporal applicability The study occurred in a technological environment that may differ from contemporary online learning. That difference should influence interpretation where relevant, but it does not automatically invalidate the evidence.
Check the eligibility criteria If the protocol contains no justified date restriction and the study otherwise meets the criteria, excluding it merely because it feels old would introduce a new rule during screening.
Retain and interpret appropriately The study can remain in the evidence base while its historical technological context is considered during synthesis.

Now change the question. Suppose the review specifically examines university experiences after a nationwide transition to a new digital-learning policy implemented in 2020. The 2012 study may now fall outside a defensible temporal boundary because it examines a different policy environment.

The paper has not become worse. The question has changed what evidence is relevant.

05 · What Researchers Often Get Wrong

Common Mistakes When Deciding Whether Research Is Too Old

Misconception

All Sources Should Be From the Last Five Years

There is no universal five-year rule for literature reviews. Some assignments, journals, or disciplines may impose recency expectations, but methodological eligibility should follow the review question and the nature of the evidence rather than an automatic five-year cutoff.

Misconception

Older Research Is Lower Quality

Publication year does not measure methodological quality. Older research may have important limitations, but those limitations need to be evaluated rather than inferred from age alone.

Misconception

A Newer Study Automatically Replaces an Older One

Two studies published years apart may examine different populations, contexts, methods, or questions. A newer study does not automatically supersede older evidence, particularly when the older work is foundational or contributes independent data.

Misconception

You Can Use a Ten-Year Cutoff to Make Screening Manageable

Reducing workload is not, by itself, a scientific rationale for excluding older evidence. Arbitrary date restrictions can remove eligible studies and potentially alter review findings.

Misconception

If the Topic Is Technological, Only Recent Studies Matter

Rapid technological change can justify temporal boundaries, but the relevant boundary should follow the technology or phenomenon itself. Older studies may still be necessary for historical development, theoretical foundations, comparison, or earlier versions of the technology when those are relevant to the question.

Misconception

A Recent Publication Always Represents Recent Conditions

Publication date and data-collection date can differ substantially. If the review concerns evidence generated after a particular policy, technological, or historical change, examine when the underlying study occurred rather than relying automatically on the year printed on the article.

06 · What This Means for You

Choose the Date Range by Asking What Changed

Before imposing a publication cutoff, identify the substantive reason that evidence before or after that date should be treated differently.

A simple decision framework

If the intervention, technology, policy, diagnostic definition, or phenomenon did not exist before a particular point
A corresponding lower date boundary may be defensible because earlier studies could not address the defined question.
If a major historical or contextual change materially altered the phenomenon
Consider whether the review is explicitly about the period before, after, or across that change and define the temporal criterion accordingly.
If the only reason for the cutoff is that five or ten years sounds sufficiently recent
Reconsider the restriction and determine whether there is a substantive reason older evidence should be excluded.
If an older study is foundational but outside a justified temporal criterion
Keep it outside the formal synthesis while using it for theoretical, historical, or methodological context when appropriate.
If time matters because the underlying context changed
Check whether publication year is actually the right temporal variable or whether study dates, implementation dates, or another characteristic better represents the boundary.

If you cannot explain why your review starts in a particular year without saying “because I wanted recent studies,” the cutoff may need stronger justification.

Also distinguish age from other eligibility questions. A study from 2008 conducted in your target population may be more directly applicable than a study from 2025 conducted in a very different population or country. Whether that difference matters should be judged through the review criteria rather than by allowing recency to dominate every other dimension of relevance.

07 · A Quick Checklist

Before Excluding a Study Because It Is Old

Ask these questions first:
Does my protocol or review plan actually contain a publication-date or study-period criterion?
What substantive change makes evidence before the proposed cutoff less relevant to my question?
Did the intervention, technology, policy, diagnostic definition, or phenomenon exist before the proposed starting date?
Am I using a five- or ten-year cutoff merely because it is conventional or convenient?
Would excluding older studies remove foundational, historical, or otherwise relevant evidence needed to answer the question?
Is publication year actually the temporal characteristic that matters, or should I consider when the study or data collection occurred?
If I use a date restriction in database searching, have I accounted for differences in database date fields and records close to the cutoff?
Can I explain and defend the date boundary in relation to the review question rather than merely to the amount of literature retrieved?
08 · Frequently Asked Questions

Questions About Old Studies and Publication-Date Cutoffs

How old can sources be in a literature review?

There is no universal maximum age. Appropriate source age depends on the review question, discipline, rate of change in the field, purpose of the source, and any justified eligibility requirements. Recent evidence may be especially important in rapidly changing areas, while older foundational or historically relevant work may remain necessary.

Do sources in a literature review have to be from the last five years?

No universal methodological rule requires this. A five-year limit may be imposed for a particular assignment, journal, or research purpose, but systematic review date restrictions should be justified by the question rather than applied automatically.

Is a ten-year publication cutoff acceptable?

It can be, if ten years corresponds to a defensible feature of the question or evidence. It is much harder to justify if the only rationale is convenience or a general preference for recent papers. Explain what makes evidence before the boundary substantively different.

Should I exclude old studies from a systematic review?

Only when they fall outside justified eligibility criteria. Cochrane discourages arbitrary date restrictions for intervention reviews because they can remove eligible evidence. If a date boundary is used, it should be specified and justified.

Can I cite an old study even if it is outside my systematic review's date range?

Yes, when it serves a legitimate contextual, theoretical, historical, or methodological purpose. Make clear that it is not part of the formally eligible evidence if it falls outside the review's inclusion criteria.

What if an old study is the original or landmark paper?

Its age does not erase its historical or scholarly importance. If you are discussing the origin of a theory, construct, instrument, method, or discovery, the original source may be particularly appropriate. Whether it also belongs in the formal evidence synthesis depends separately on the review's eligibility criteria.

Should technology reviews include only recent studies?

Not automatically. Determine whether older studies concern technologies that are substantively different from the phenomenon defined by your question. A technology-based eligibility definition may sometimes be more precise than an arbitrary publication-year cutoff.

Should I use publication year or the year the data were collected?

That depends on why time matters. If your concern is whether evidence reflects a particular policy, technology, or historical context, the study or data-collection period may be more meaningful than publication year. Define the temporal criterion that best represents the substantive boundary in your question.

09 · The Bottom Line

A Study Is Not Too Old Until You Can Explain Why Its Age Matters

The Bottom Line

Do not exclude a study simply because it is old; exclude it on temporal grounds only when the review has a justified date or period criterion that reflects a meaningful boundary in the question or evidence.

Technology, policy, practice, diagnostic definitions, and historical context can make time highly relevant, but arbitrary five- or ten-year rules may discard useful evidence. Decide what changed, identify which temporal characteristic actually captures that change, and let the review question determine the date range rather than allowing the calendar to make the decision for you.

10 · Sources and Further Reading

Authoritative Guidance on Publication-Date Restrictions

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes