Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Do You Need Two People to Screen the Literature?

Two reviewers are often used to reduce errors and individual judgment in study selection, but the requirement depends on the review methodology and screening stage. Learn when independent duplicate screening is expected and what “two reviewers” actually means.

128
Do You Need Two Literature Screeners? Guide 128 of 247
01 · The Question

Does Every Paper Really Need to Be Screened by Two People?

Screening can be one of the most labor-intensive parts of a systematic review. If your search produces 3,000 records, having two researchers independently examine every title and abstract effectively creates 6,000 screening decisions before anyone even reaches the full texts.

So is a second reviewer genuinely necessary?

For some review methodologies and stages, yes. For others, duplicate screening is strongly preferred rather than universally mandatory. The answer also changes depending on whether you are talking about preliminary title and abstract screening or the final decision to include or exclude a potentially eligible study.

The reason for using two reviewers is not ceremonial. Study selection involves judgment, and a single mistaken exclusion can remove relevant evidence from the review. Independent assessment creates an opportunity to detect errors, expose ambiguous eligibility criteria, and reduce the extent to which one person's assumptions determine the evidence base.

02 · The Short Answer

For Systematic Reviews, Two Independent Reviewers Are Often the Safer Standard

In Brief

For systematic reviews, using two people to assess study eligibility independently is a widely recommended safeguard, and some methodologies require it, particularly for final full-text inclusion decisions.

The exact requirement depends on the review framework. Cochrane intervention reviews require at least two people working independently for final eligibility decisions based on potentially eligible studies, while duplicate title and abstract screening is desirable but not mandatory. JBI systematic review methods generally call for two or more reviewers independently at both title-and-abstract and full-text stages.

03 · What You Need to Know

Two Reviewers Are Used to Protect the Selection Decision, Not Merely to Divide the Work

Study Selection Is a Judgment Task

Eligibility criteria may look objective on paper: correct population, correct intervention, eligible study design, appropriate context. Applying those criteria to real publications is often less straightforward.

An abstract may describe the population vaguely. A study design may be difficult to classify. Two reviewers may interpret “higher education” differently. One person may overlook a sentence that establishes ineligibility. Another may exclude a study because a detail appears absent from the abstract even though the detail is reported in the full text.

Cochrane describes inclusion decisions as among the most influential decisions made during a review and emphasizes that they involve judgment. Its rationale for duplicate eligibility assessment is that using more than one reviewer can reduce both mistakes and the possibility that study selection is influenced by a single person's biases.

This matters because screening determines which evidence is allowed to contribute to the review. A statistical analysis cannot recover a relevant study that was incorrectly removed before the analysis began.

“Two Reviewers” Usually Means Independent Decisions

Simply putting two researchers in front of the same screen is not what methodological guidance generally means by duplicate independent screening.

Independent screening Each reviewer assesses the record or report without knowing or being influenced by the other reviewer's decision before making their own judgment.
Consensus screening Two people discuss each paper together and produce one shared decision from the beginning.

Consensus screening can involve two people, but it does not provide the same check on individual judgment. If Reviewer A immediately says, “This is obviously irrelevant,” Reviewer B's assessment may be influenced before an independent decision has been formed.

In a conventional dual-screening workflow, each reviewer records an include, exclude, or other permitted decision independently. Their decisions are then compared. Agreement proceeds automatically, while disagreements enter a predefined resolution process.

Title and Abstract Screening and Full-Text Screening Are Not Necessarily Governed by the Same Rule

This distinction is crucial.

For Cochrane intervention reviews, at least two people working independently are mandatory for determining whether potentially eligible studies finally meet the eligibility criteria. Duplicate title and abstract screening is described as desirable but not mandatory, meaning one person may conduct that initial screening under the Cochrane intervention-review standard.

JBI guidance is stricter for many of its systematic review methodologies. Its Manual for Evidence Synthesis states that selection at both title-and-abstract and full-text stages should be performed independently by two or more reviewers, with disagreements resolved through consensus or another reviewer.

Screening stage Cochrane intervention reviews JBI systematic review approach
Title and abstract Two independent reviewers desirable, but one reviewer acceptable under the stated standard Two or more independent reviewers expected
Full-text eligibility At least two people working independently required Two or more independent reviewers expected
Disagreements Resolution process defined in advance Consensus or another reviewer

There is therefore no responsible universal answer such as “every literature review always needs exactly two screeners.” The applicable methodology matters.

PRISMA Does Not Itself Tell You That Exactly Two Reviewers Must Screen

This is another distinction researchers sometimes miss.

PRISMA 2020 is primarily a reporting guideline. It asks systematic reviewers to report how studies were selected, including how many reviewers screened each record and each retrieved report, whether reviewers worked independently, and how disagreements were resolved.

PRISMA therefore makes the selection process transparent. The methodological requirement for one, two, or more reviewers comes from the review methodology you are following, such as Cochrane, JBI, or another evidence-synthesis framework.

Conduct guidance Specifies how the review should be performed, including requirements or recommendations concerning independent reviewers.
Reporting guidance Specifies what you should tell readers about how the review was actually performed.

This distinction prevents a common mistake: citing PRISMA as though it were the methodological authority requiring every screening decision to be duplicated.

Why Does Independent Screening Reduce Errors?

Screening errors can occur for ordinary reasons.

A reviewer may:

  • misread an abstract;
  • overlook an eligible subgroup;
  • interpret an eligibility criterion incorrectly;
  • click the wrong screening option;
  • assume that missing information establishes ineligibility;
  • misclassify a study design; or
  • become less careful after screening hundreds of records.

Independent duplicate screening creates redundancy. If one reviewer makes an error and the other does not, the disagreement brings the record back for examination.

Cochrane cites empirical evidence suggesting that using at least two reviewers may reduce the possibility that relevant reports are discarded, while also acknowledging research exploring more efficient single-screening approaches.

The second reviewer is therefore not assumed to be infallible. The protection comes from independent judgments being compared.

A Second Reviewer Also Helps Detect Ambiguous Criteria

Disagreement is not always evidence that one reviewer made a mistake.

Suppose your inclusion criteria specify “postsecondary students.” Reviewer A includes students enrolled in vocational colleges. Reviewer B interprets postsecondary education as degree-granting universities only.

The disagreement has revealed something important: the criterion does not operationally specify what the team means by postsecondary education.

That discovery can improve the review if it occurs during pilot screening. The team can clarify the criterion and then apply the resulting interpretation consistently across subsequent records.

Without independent decisions, such ambiguity may remain invisible because one person's interpretation quietly becomes the review's interpretation.

Do the Two Reviewers Need to Have the Same Expertise?

Not necessarily.

Cochrane notes that content experts can have pre-existing views that influence assessments of relevance and validity. It suggests that although at least one review author should know the subject area, there may be advantages to having another reviewer who is not a content expert.

That does not mean content expertise is undesirable. Screening often requires enough subject knowledge to recognize terminology, populations, interventions, and study designs correctly.

A complementary team can be useful. One reviewer may bring deep domain knowledge, while another contributes methodological expertise and a less assumption-laden reading of the literature.

The essential requirement is that both understand the eligibility criteria well enough to apply them reliably.

Pilot Screening Before the Main Screening Can Prevent Hundreds of Disagreements

Two reviewers who interpret the criteria differently will not solve the problem simply by independently repeating that disagreement across 5,000 records.

Before full screening begins, test the criteria on a sample of records.

Choose a pilot sample Include clearly eligible, clearly ineligible, and genuinely ambiguous records where possible.
Screen independently Each reviewer applies the current criteria without seeing the other's decisions.
Compare decisions Identify disagreements and determine what caused them.
Clarify the criteria Resolve ambiguous terminology and establish operational rules for recurring situations.
Begin formal screening Use the agreed criteria and the predefined disagreement-resolution procedure.

This calibration is especially valuable when several screening pairs are working on the same review. Otherwise, different pairs can gradually develop different interpretations of the same eligibility criteria.

What Happens When the Two Reviewers Disagree?

Disagreement is expected. The review protocol should specify how it will be resolved.

Cochrane states that disagreements can often be resolved through discussion. If disagreement reflects different interpretations rather than a simple oversight, another person may need to arbitrate. When necessary information is unavailable, a study may remain awaiting assessment until additional information is obtained.

JBI similarly specifies consensus or a third reviewer for resolving disagreements.

A typical disagreement process

If the disagreement results from an obvious oversight
Review the relevant information and agree on the corrected decision.
If reviewers interpret a criterion differently
Discuss the intended operational meaning and apply the resolved interpretation consistently to comparable records.
If consensus cannot be reached
Use the predefined third-reviewer or arbitration procedure.
If the necessary information is unavailable
Seek additional information or use the unresolved-status procedure specified by the review methodology rather than forcing an unsupported decision.

The third reviewer should not merely vote on personal preference. The purpose is to resolve the decision against the review's criteria and available evidence.

Do You Need a Third Reviewer From the Beginning?

Not necessarily as a routine screener.

A common design uses two independent reviewers and a third person who becomes involved only when disagreements cannot be resolved through discussion. This person may also help clarify difficult eligibility questions during pilot screening.

The important point is to define the procedure before disagreements occur. Deciding who will arbitrate only after a contentious paper appears can make the process less predictable.

Should Reviewers Be Blinded to Authors, Journals, and Institutions?

In theory, blinding might reduce influence from author reputation, journal prestige, institution, or prior knowledge. In practice, meaningful blinding during screening can be difficult because titles, abstracts, terminology, interventions, and citations can reveal a study's identity.

Major review guidance generally focuses on independent eligibility assessment rather than requiring reviewers to conceal authorship or journal information.

The more important safeguard is to apply explicit eligibility criteria consistently and independently. A famous author should not receive more generous eligibility treatment than an unfamiliar research group.

What If You Are the Only Researcher Available?

This is where review type matters considerably.

If you are conducting a review under a methodology that requires independent duplicate eligibility assessment, being the only available researcher does not make the requirement disappear. You may need to involve a co-reviewer, supervisor, collaborator, or other appropriately trained person for the required stage.

Cochrane, for example, will not publish a review proposed to be undertaken by a single person and emphasizes team-based independent work for key tasks such as study selection.

For a review methodology in which duplicate title and abstract screening is desirable rather than mandatory, a single screener may be methodologically permissible at that stage. You should still report what you actually did rather than describing the process as duplicate screening.

If you are conducting a student literature review, narrative review, or another review not governed by a systematic-review methodology requiring independent duplicate selection, a second screener may not be necessary at all. Do not import procedural requirements merely to make the review sound systematic.

Can One Reviewer Screen and Another Person Check Only the Exclusions?

This is sometimes proposed as a compromise.

One reviewer screens every record. A second reviewer then checks only those marked for exclusion, or checks a sample of decisions.

This is not equivalent to conventional independent duplicate screening because the second person's role and exposure to the first decision differ. However, alternative screening approaches are an active methodological area, and some review contexts use modified procedures to reduce workload.

If you adopt such an approach, do not call it “two independent reviewers screened all records” unless that is actually what happened. Describe the procedure accurately, explain its methodological basis where needed, and ensure that it complies with the review framework you are following.

What About Automation and AI-Assisted Screening?

Automation tools can prioritize records, classify likely study designs, remove clearly ineligible records under specified procedures, or otherwise support screening. Their use does not eliminate the need to define who or what made each eligibility decision.

PRISMA 2020 specifically asks authors to report automation tools used during study selection, how they were integrated into the process, and, where applicable, how classifiers were trained or validated.

The methodological acceptability of replacing a human reviewer with automation depends on the review framework, tool, workflow, and evidence supporting that use. Do not assume that “AI-assisted” automatically satisfies a requirement for two independent human reviewers.

Watch Out

Do not write that studies were screened by “two independent reviewers” if one person made the decisions and another merely approved them afterward, if the reviewers discussed each record before deciding, or if an automated tool acted as the second screener without your methodology supporting that substitution. Describe the selection process you actually used.

Two Reviewers Do Not Fix Poor Eligibility Criteria

Duplicate screening can detect inconsistent application. It cannot rescue criteria that are fundamentally vague or poorly aligned with the review question.

If both reviewers consistently apply a bad criterion, the decisions can be perfectly reproducible and still methodologically weak.

The sequence matters:

Define defensible criteria → operationalize them clearly → pilot them → screen independently → resolve disagreements consistently.

This is why duplicate screening should be viewed as one safeguard within study selection rather than a certificate of rigor by itself.

Different Review Types Need Different Screening Procedures

The phrase “literature review” covers methods with very different expectations.

A Cochrane intervention review has explicit requirements for independent final eligibility assessment. JBI systematic reviews generally use independent duplicate screening at both major selection stages.

A narrative literature review, by contrast, may be conducted by one scholar selecting literature through an interpretive process. It would be misleading to suggest that such a review is automatically invalid because every citation was not independently screened twice.

The appropriate question is therefore:

What selection procedure does the review methodology I am claiming to use require?

Once that is established, follow it and report it accurately.

04 · A Practical Example

What Does Independent Dual Screening Look Like in Practice?

Hypothetical Example

Two Reviewers Screen 1,200 Records

Suppose a systematic review examines university students' experiences of generative AI-generated feedback. After deduplication, 1,200 records remain. The review methodology calls for independent screening by two reviewers.

Reviewer A screens independently Reviewer A examines each title and abstract against the population, phenomenon, context, and evidence-type criteria without seeing Reviewer B's decisions.
Reviewer B screens independently Reviewer B assesses the same records using the same criteria without seeing Reviewer A's decisions.
The decisions are compared The reviewers agree on 1,105 records. Ninety-five records produce disagreement.
Disagreements are examined Many are simple oversights. Several reveal that the phrase “generative AI feedback” needs a clearer operational definition because one reviewer included conventional automated-feedback systems.
The rule is clarified The team returns to the protocol and establishes a common interpretation consistent with the intended phenomenon. Relevant earlier decisions are revisited where necessary.
Potentially eligible reports move to full text The reviewers independently assess the complete reports and resolve remaining disagreements through consensus, with a third reviewer available if needed.

The benefit of the second reviewer is visible in two places. Individual mistakes are caught, but the process also exposes an ambiguity in the eligibility criteria that might otherwise have shaped the entire review unnoticed.

05 · What Researchers Often Get Wrong

Common Misunderstandings About Using Two Reviewers

Misconception

Every Literature Review Requires Two Screeners

No. The requirement depends on the review methodology. Independent duplicate selection is a central safeguard in many systematic review methods, but an ordinary narrative literature review does not automatically require two people to screen every source.

Misconception

PRISMA Requires Exactly Two Reviewers

PRISMA 2020 asks authors to report how many reviewers screened records and reports, whether they worked independently, and how disagreements were resolved. The methodological requirement for duplicate screening comes from the conduct framework used for the review rather than PRISMA itself.

Misconception

Two People Discussing Every Paper Together Counts as Independent Screening

Not in the conventional sense. Independence requires each reviewer to form a decision without first being influenced by the other's judgment. Discussion is typically used after independent decisions have been compared.

Misconception

The More Experienced Reviewer Should Automatically Overrule the Other

Reviewer seniority is not an eligibility criterion. Disagreements should be resolved against the predefined criteria and available study information, using the agreed arbitration process when consensus cannot be reached.

Misconception

If Reviewers Disagree Often, One of Them Is Bad at Screening

Frequent disagreement may indicate insufficient training, but it can also expose ambiguous criteria or difficult reporting in the underlying literature. Investigate the pattern before assuming that one reviewer is simply wrong.

Misconception

Two Reviewers Guarantee That No Study Will Be Missed

No screening procedure eliminates error completely. Duplicate independent assessment reduces particular risks but does not compensate for an inadequate search, poorly defined criteria, unavailable reports, or mistakes shared by both reviewers.

06 · What This Means for You

Let the Review Methodology Determine How Much Duplication You Need

Before recruiting a second screener, identify the methodology governing your review. Do not begin with the assumption that all reviews require the same arrangement.

A simple decision framework

If your review methodology requires independent duplicate eligibility assessment
Use at least the required number of reviewers, ensure they make decisions independently, and define the disagreement-resolution procedure in advance.
If duplicate title and abstract screening is recommended but not mandatory
Consider the additional protection against missed studies alongside available time and resources, and report whichever procedure you actually use.
If you are following JBI systematic review methods
Plan for two or more independent reviewers at title-and-abstract and full-text selection stages, with consensus or another reviewer used to resolve disagreements.
If you are conducting a narrative or other non-systematic literature review
Do not add duplicate screening merely to imitate systematic-review procedures unless it genuinely serves the review's purpose.
If only one reviewer is available but the methodology requires two
Seek an appropriately trained second person rather than silently replacing the required procedure with single screening.

If you use two reviewers, pilot the criteria before full screening and decide in advance what happens when they disagree. This is particularly important for recording final exclusion decisions and their reasons, because unresolved differences should not produce inconsistent documentation.

And report the procedure precisely. “Two reviewers participated in study selection” is less informative than stating which stages they screened, whether they worked independently, and how disagreements were resolved. PRISMA 2020 specifically asks for these details.

07 · A Quick Checklist

Before You Begin Literature Screening

Check your reviewer arrangement:
What does the methodology governing my review require for title-and-abstract screening?
What does it require for final full-text eligibility decisions?
If two reviewers are used, will they make their initial decisions independently?
Have both reviewers been trained to interpret the inclusion and exclusion criteria in the same operational way?
Have we pilot-tested the criteria on enough records to expose obvious ambiguities before large-scale screening?
Is the process for resolving disagreements defined before formal screening begins?
If a third reviewer may be needed, is that person's role clear?
Can the final report accurately state how many reviewers screened each stage, whether they worked independently, and how disagreements were handled?
08 · Frequently Asked Questions

Questions About Using Two Reviewers for Literature Screening

Do systematic reviews always require two reviewers?

Many systematic review methodologies require or strongly recommend independent duplicate assessment for key tasks, but the exact requirement varies. Cochrane intervention reviews require at least two independent reviewers for final study eligibility decisions, while duplicate initial title and abstract screening is desirable rather than mandatory. JBI systematic review methods generally expect independent duplicate screening at both stages.

Does PRISMA require two independent reviewers?

PRISMA 2020 is a reporting guideline rather than a universal conduct standard. It asks you to report how many reviewers screened records and reports, whether they worked independently, and how disagreements were resolved. Follow the relevant review methodology to determine what screening arrangement is required.

Do both reviewers have to screen every title and abstract?

It depends on the methodology. Cochrane intervention-review guidance describes duplicate independent title and abstract screening as desirable but not mandatory. JBI systematic review guidance generally calls for two or more independent reviewers at this stage.

Do both reviewers need to screen every full-text paper?

For Cochrane intervention reviews, at least two people working independently are required to make final eligibility decisions for potentially eligible studies using full texts when possible. JBI systematic review methods likewise generally use independent assessment by two or more reviewers at full text.

What happens if the two reviewers disagree?

Follow the procedure defined for the review. Disagreements are commonly discussed first, with a third reviewer or other arbitration process used when consensus cannot be reached. If the disagreement results from missing study information, additional information may need to be sought before a final decision is made.

Can my thesis adviser be the second reviewer?

Potentially, if that person can perform the screening role required by your methodology and can apply the eligibility criteria independently. Their academic title is less important than whether the screening procedure genuinely meets the methodological requirement.

Can AI be my second reviewer?

Do not assume that an AI or automation tool automatically satisfies a requirement for a second independent reviewer. Automation-assisted screening is an active methodological area, and acceptability depends on the review framework and validated workflow. If automation is used, PRISMA 2020 asks reviewers to report how the tool was integrated and, where relevant, how its performance was evaluated.

Do narrative literature reviews need two reviewers?

Not as a universal requirement. Narrative reviews generally do not operate under the same duplicate-screening standards as systematic reviews. If you claim to follow a specific systematic or evidence-synthesis methodology, however, use the reviewer procedures required by that methodology.

09 · The Bottom Line

Two Reviewers Are a Safeguard, but the Exact Requirement Comes From Your Review Method

The Bottom Line

You do not need two people to screen every kind of literature review, but independent assessment by at least two reviewers is an important safeguard in systematic reviews and is required for key selection decisions under several major evidence-synthesis methodologies.

Check the methodology you are actually following. When duplicate screening is required, reviewers should make decisions independently before disagreements are resolved. When it is optional, weigh the additional protection against errors and individual judgment against available resources, and always report the selection process exactly as it was performed.

10 · Sources and Further Reading

Authoritative Guidance on Independent Literature Screening

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes