03 · What You Need to Know
How to use the newest evidence before peer review is complete
First identify what kind of research output you actually found
“Not peer reviewed” can describe several different situations. The most familiar is a preprint: a complete research manuscript made publicly available before certification through journal peer review. NIH describes preprints as a common form of interim research product and requires NIH-supported interim products to state clearly that the work is not peer reviewed.
You might also encounter working papers, conference materials, reports, datasets, technical documents, or manuscripts shared through repositories. These outputs do not all have identical purposes, screening processes, or publication trajectories.
Before using one, determine what it is, where it came from, whether it has a persistent record, and what review or screening it has actually undergone.
Preprint or other unreviewed research output
Research made available before completion of the journal peer-review process, with its preliminary status requiring explicit recognition.
Peer-reviewed journal article
A manuscript that has undergone the journal's peer-review and editorial process before acceptance, although that process does not guarantee that every claim is correct.
Peer review is meaningful, but it is not a correctness certificate
The International Committee of Medical Journal Editors describes peer review as critical assessment by experts and an important extension of the scientific process. It can help editors judge manuscripts and can improve research reporting.
That additional scrutiny matters. Reviewers may identify unclear methods, inappropriate analyses, unsupported interpretations, missing literature, or other weaknesses before publication.
But peer review does not independently reproduce the study. Editors can make decisions that do not simply mirror reviewer recommendations, and published research can still contain errors, limitations, or conclusions that later evidence challenges.
The useful distinction is therefore not “unreviewed means false” versus “peer reviewed means true.” It is that unreviewed research has not yet passed through an additional layer of formal scholarly scrutiny that may identify problems or prompt revisions.
Ask why you need the newest evidence
The importance of peer-review status partly depends on what you are trying to do.
If you are mapping an emerging field, identifying research directions, discussing what researchers are currently investigating, or designing future research, knowing about a relevant preprint may be extremely useful.
If you are making a strong causal claim, recommending a consequential intervention, developing institutional policy, or supporting a decision in which an erroneous conclusion could cause substantial harm, the evidential threshold should generally be higher.
| How you want to use the research |
Potential role of unreviewed evidence |
Appropriate caution |
| Identify emerging research directions |
Often highly useful |
Describe findings as preliminary rather than settled |
| Develop a research question or hypothesis |
Can reveal new problems, methods, and findings |
Check whether later versions change the interpretation |
| Discuss the newest developments in a literature review |
May be useful when clearly identified |
Distinguish it from peer-reviewed evidence |
| Support a central empirical claim |
Potentially useful but requires close appraisal |
Look for corroborating evidence and avoid overstating certainty |
| Support a high-stakes decision |
May provide an early signal |
Independent corroboration and stronger evidential maturity become especially important |
Do not let recency substitute for evidential strength
The newest study has an obvious informational advantage: it can address conditions that older studies could not. This is particularly important for rapidly changing technologies, policies, outbreaks, social phenomena, or emerging interventions.
But recency does not make a study methodologically strong. A new preprint can use an inappropriate design, weak measures, a small or biased sample, questionable analyses, or conclusions broader than its evidence supports.
Conversely, older peer-reviewed research may provide stronger evidence but examine conditions that have since changed.
This creates a genuine trade-off rather than a simple hierarchy. The appropriate question is not “new or peer reviewed?” It is “which evidence is appropriate for the claim I need to make, and what uncertainty remains?”
This is closely related to deciding how recent research needs to be for the question you are asking.
Evaluate the study, not just its publication status
Once an unreviewed study is sufficiently relevant to deserve attention, evaluate it using the same substantive questions you would apply to published research, with additional caution because formal peer review is incomplete.
Examine the research question, design, sample or dataset, measures, procedures, analyses, uncertainty, limitations, and correspondence between the evidence and conclusions. Where appropriate, look for preregistration, protocols, data, code, supplementary materials, funding disclosures, and competing interests.
If you have not yet decided whether the manuscript warrants that effort, first consider whether the new preprint is worth paying attention to.
Look for corroboration rather than treating one early result as the new consensus
A striking preprint can attract disproportionate attention precisely because it is new and surprising. One result, however, does not automatically overturn an established evidence base.
If the finding conflicts with earlier research, investigate the disagreement. Did the study examine a different population? Use a different intervention or measure? Analyze a newer version of a technology? Employ a stronger design? Or could the apparent contradiction reflect sampling variation, analytic choices, or methodological limitations?
If several independent studies using different approaches begin reaching compatible conclusions, confidence may reasonably increase. If one unreviewed study stands alone against a large and coherent evidence base, more restraint is warranted.
Watch Out
A preprint can be important enough to discuss without being strong enough to redefine the state of knowledge. Avoid phrases such as “research has proven” or “the evidence now shows” when the claim rests primarily on a single preliminary study.
Always check whether you are looking at the current version
Preprints can be revised. Authors may correct errors, add analyses, alter figures, clarify methods, or modify conclusions after receiving feedback.
NIH guidance on interim research products emphasizes versioning, and the ICMJE recommends that preprint archives maintain mechanisms connecting readers with subsequent versions, including final published articles.
Before citing or relying on a preprint, return to its repository record and check:
- whether a newer preprint version exists;
- whether the manuscript has been withdrawn;
- whether the authors have linked a peer-reviewed publication;
- whether substantive public comments or evaluations are available;
- whether important metadata, disclosures, or supporting materials have changed.
A PDF downloaded six months ago is not necessarily the version you should be reading today.
If a peer-reviewed version exists, usually prefer it
The ICMJE recommends that when a preprint has subsequently been published in a peer-reviewed journal, authors should cite the published article rather than the preprint whenever appropriate. It also recommends clearly identifying cited preprints as preprints.
This is a useful general practice beyond biomedical publishing. If the research has progressed to a peer-reviewed publication, the later article ordinarily represents the more mature scholarly record.
Do not assume the two versions are identical. Compare them when your argument depends on a result, method, sample, analysis, or conclusion that may have changed.
Cite the status you actually used
If you use a preprint, make its status visible rather than formatting the reference in a way that makes it appear to be a journal article.
ICMJE explicitly recommends that citations clearly indicate when a reference is a preprint. NIH similarly instructs researchers citing interim research products in relevant applications and reports to identify the type of interim product.
This transparency allows readers to calibrate their own interpretation. They should not have to investigate the DOI or repository themselves to discover that the evidence had not completed peer review when you used it.
Check the rules governing your particular work
The fact that preprints can be cited does not mean every journal, institution, funder, discipline, or assignment handles them identically.
ICMJE advises authors to consult individual journal policies regarding preprints and notes that journals should describe their policies in their instructions to authors. Some contexts may permit or encourage preprint citation; others may impose restrictions or preferences.
If you are preparing a manuscript, thesis, dissertation, grant proposal, or formal evidence synthesis, verify the requirements that actually apply to that work rather than relying on a general assumption.
Systematic reviews require protocol-based decisions about preprints
In a formal evidence synthesis, the question is not simply whether you personally trust a preprint. The review should have explicit eligibility criteria and search methods that determine which reports can enter the evidence base.
Cochrane guidance recommends comprehensive searching across appropriate sources and recognizes that studies may be reported in forms other than conventional journal articles. Review teams should therefore decide deliberately how unpublished, ongoing, or non-journal reports fit the review question and protocol.
If preprints are eligible, they should be identified appropriately and tracked carefully because their publication status may change while the review is underway.
The latest evidence may change while you are writing
Fast-moving fields create a timing problem. A preprint you discuss in a draft may become a journal article before submission. Another may be revised substantially. A newly peer-reviewed study may appear that changes the interpretation of the preliminary evidence.
This is why mechanisms for finding new research without constantly starting another search can be useful during long projects. Citation alerts, topic alerts, and researcher monitoring can also help you notice when the evidence surrounding an important preprint changes.
Before finalizing a manuscript that relies materially on unreviewed research, perform a fresh status check.