Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

What Should You Look for When Screening Titles and Abstracts?

Title and abstract screening is not about deciding whether a paper is good or reading it in full. Your task is to identify clearly ineligible records while retaining anything that could reasonably meet your review criteria.

117
Screening Titles and Abstracts Guide 117 of 247
01 · The Question

What Are You Actually Trying to Decide From a Title and Abstract?

Title and abstract screening can look deceptively simple. Read the title, scan the abstract, click include or exclude, and move on.

The difficulty begins when the record is not obviously relevant or irrelevant. The population sounds close to yours but is described vaguely. The intervention fits, but the setting is unclear. The abstract never mentions the outcome you need. A study sounds promising, yet you cannot determine its design. Now what?

The purpose of this stage is not to understand each paper completely. It is not even to make the final inclusion decision in every case. You are trying to determine whether the information available in the title and abstract is sufficient to establish that a record is clearly ineligible, or whether it remains sufficiently plausible to warrant further assessment.

That distinction matters because screening too loosely creates unnecessary full-text work, while screening too aggressively can remove relevant evidence before you ever see the paper.

02 · The Short Answer

Screen Against Your Eligibility Criteria, Not Against a General Impression of Relevance

In Brief

When screening titles and abstracts, look for the information needed to determine whether each record clearly fails or could reasonably satisfy your review's eligibility criteria, such as the population, intervention or phenomenon, context, study design, and other criteria that genuinely define your review.

You do not need every criterion to be explicitly confirmed at this stage. If an essential detail is missing or ambiguous and the record could still be eligible, retain it for further assessment rather than treating missing information as evidence for exclusion.

03 · What You Need to Know

Title and Abstract Screening Is an Exercise in Ruling Out, Not Proving In

Start With the Criteria You Already Defined

Screening becomes inconsistent when researchers approach each abstract with a vague question such as, “Does this look relevant?” Two papers can feel equally relevant while satisfying very different parts of the review question.

A more defensible approach is to translate your inclusion and exclusion criteria into screening questions.

Depending on the review, you might ask:

  • Does the population appear eligible?
  • Does the study address the intervention, exposure, phenomenon, or concept of interest?
  • Is the setting or context within scope?
  • Does the study design appear eligible?
  • Does the publication type satisfy the review criteria?
  • Are any other explicitly defined eligibility requirements clearly met or clearly violated?

Not every review needs every one of these questions. The screening form should reflect the actual eligibility criteria rather than becoming a generic checklist that researchers mechanically apply to every topic.

This is why study selection begins before screening. You first need a defensible basis for deciding which papers belong within the review. Title and abstract screening then applies those boundaries to the records your search has retrieved.

The Title Is Useful, but It Rarely Tells the Whole Story

A title can sometimes establish ineligibility immediately. If your review concerns university students and the title explicitly states that the study investigated preschool children, you may already have enough information to exclude the record on population.

Other titles are much less informative:

“Student Experiences With Artificial Intelligence in Education”

Which students? What kind of artificial intelligence? What educational setting? Is this empirical research, a commentary, or a review?

A title like this should not be interpreted more confidently than the information allows. If it could plausibly describe an eligible study, read the abstract.

Clearly ineligible title The title itself provides enough information to establish that an essential eligibility criterion is not met.
Unclear title The title does not provide enough information to decide, so the abstract needs to be examined.

The objective is not to eliminate records as quickly as possible. It is to eliminate them as quickly as the evidence permits.

Population: Are These the People or Units Your Question Concerns?

Population is often one of the easiest characteristics to identify, but terminology can create ambiguity.

Suppose your review includes undergraduate university students. An abstract explicitly describing elementary-school pupils is clearly outside that criterion. One describing “college students” may clearly qualify depending on how your criteria were defined. Another referring only to “learners” may require further investigation.

Population can also be mixed. A study might include secondary-school and university students but provide separate results for each group. Whether that study is eligible depends on your criteria and whether usable information for the eligible subgroup can be identified.

Do not reduce population screening to spotting the right noun. Ask whether the participants or units of analysis actually correspond to the population defined by the review.

Intervention, Exposure, or Phenomenon: Is the Study Actually About What You Are Reviewing?

Shared terminology can conceal substantial conceptual differences.

A review of generative AI-generated feedback might retrieve studies of automated essay scoring, intelligent tutoring systems, conventional chatbots, machine-learning prediction, and rule-based feedback systems. All may use terms such as “artificial intelligence,” “automated feedback,” or “digital learning.” They are not necessarily investigating the same phenomenon.

Read enough of the abstract to determine what was actually studied rather than relying on keyword overlap.

This becomes particularly important when technologies, interventions, or concepts have changed over time. The terminology used by authors may be broader, narrower, older, or simply different from the terminology used in your review.

Context: Does the Setting Matter to Eligibility?

Some review questions are highly context-dependent. A study conducted in a hospital may not answer a question specifically about primary care. Workplace training may not satisfy criteria limited to formal higher education. Research conducted during emergency remote teaching may or may not fit a review of deliberately designed online learning.

But context should only drive exclusion when it is genuinely part of the eligibility criteria. Do not invent new restrictions during screening merely because a setting differs from what you expected to find.

The same principle applies to geographical restrictions. A study from another country is not inherently irrelevant. Whether geography matters depends on the review question and the criteria established for it.

Study Design: Is This the Kind of Evidence the Review Requires?

If your review restricts eligibility by study design, titles and abstracts may provide clues through terms such as “randomized controlled trial,” “cross-sectional survey,” “cohort study,” “qualitative interviews,” or “systematic review.”

Yet authors do not always label designs consistently. An abstract may describe methods without naming the design, or use terminology differently from the definitions in your protocol.

Look at what the researchers actually did. Who was recruited? Was an intervention assigned? Were participants followed over time? Were data collected through interviews? Is the article reporting original empirical research or synthesizing previous studies?

If you cannot confidently determine the design from the abstract and design determines eligibility, retain the record until more information is available.

Outcome Criteria Require Particular Caution

Researchers sometimes exclude a record because the abstract does not mention the outcome they are interested in. That can be risky.

Not every measured outcome appears in an abstract. Cochrane specifically cautions that outcomes may be poorly represented in titles, abstracts, and database indexing. It also states that eligible studies should not be excluded solely because measured outcome data are not reported in a usable way.

There is an important distinction here. If your eligibility criteria legitimately require that a particular outcome was measured, evidence that the study did not measure that outcome may establish ineligibility. But an abstract that simply does not mention the outcome does not necessarily tell you whether it was measured.

Watch Out

“Not mentioned in the abstract” and “not present in the study” are not equivalent. If an omitted detail determines eligibility, you may need the full text before making the decision.

Do Not Perform Full Critical Appraisal During Initial Screening

During title and abstract screening, you may notice a small sample, an unusual analytic method, or a design you personally consider weak. Unless these features violate predetermined eligibility criteria, they do not automatically justify exclusion.

Eligibility and methodological appraisal are conceptually different. A study can be relevant while still having methodological limitations, and the appropriate response to those limitations depends on the review methodology.

Trying to perform a miniature critical appraisal during abstract screening also encourages inconsistent decisions because abstracts rarely contain enough methodological detail for a defensible assessment.

Read the Abstract for Evidence, Not for Keywords

Keyword matching helped retrieve the record. Screening asks a different question.

Consider an abstract containing all of your search terms but stating that the study examined instructors' intentions to use generative AI rather than students' experiences of receiving AI feedback. Keyword overlap is high; substantive eligibility is low.

Conversely, an eligible paper may use terminology you did not expect. “Large language model-generated formative comments” could describe the same phenomenon your review calls “generative AI feedback.”

Screen concepts, not strings of words.

Missing Information Should Usually Produce Uncertainty, Not Exclusion

This is perhaps the most important habit in early screening.

Cochrane recommends that reviewers generally be over-inclusive when examining titles and abstracts. The reason is asymmetric risk. Keeping an irrelevant record for full-text assessment costs additional time. Incorrectly excluding a relevant record can remove evidence from the review altogether.

What the title or abstract tells you Likely screening decision Why
Clearly violates an essential criterion Exclude The available information establishes ineligibility
Clearly appears to satisfy the relevant criteria Retain The record remains potentially eligible
Essential information is missing Retain for further assessment Missing information does not establish ineligibility
Wording is ambiguous Retain for further assessment The uncertainty needs more information
Interesting but clearly outside the criteria Exclude from the review evidence Interest is not eligibility

If an abstract genuinely does not provide enough information, the next question is not how to guess more accurately. It is what to do when the abstract is insufficient for a defensible selection decision.

Use a Consistent Order When It Helps You Screen Efficiently

You do not necessarily need to inspect every criterion in every abstract once a clear exclusion has been established. If your review requires university students and an abstract explicitly studies infants, examining every outcome and methodological detail adds little.

A screening form can therefore place easily identified, highly discriminating criteria earlier. The exact sequence depends on the review.

Population Does the record clearly involve an eligible population?
Phenomenon or intervention Is the study actually examining what the review concerns?
Context Does it fall within any setting boundaries required by the question?
Study characteristics Does it satisfy any eligible design or publication-type requirements?
Uncertainty check Is any apparent failure actually caused by missing or ambiguous information?

This is an efficiency device, not a universal hierarchy. Your review question determines which criteria matter and in what order they can sensibly be assessed.

Screening Rules Should Be Calibrated Before the Main Work Begins

Eligibility criteria can look perfectly clear on paper until two reviewers apply them to actual abstracts and interpret them differently.

Pilot screening a sample of records can reveal ambiguous definitions before those ambiguities affect hundreds of decisions. One reviewer may interpret “higher education” as universities only, while another includes vocational colleges. One may treat blended learning as online learning; another may not.

These disagreements are useful signals. They show where operational definitions need clarification.

For Cochrane intervention reviews, at least two people working independently are required for final full-text eligibility decisions, while duplicate title and abstract screening is desirable but not mandatory. Requirements differ across review methodologies, so the screening procedure should follow the methodological guidance applicable to the review rather than assuming one arrangement fits every evidence synthesis.

04 · A Practical Example

How Would You Screen These Five Abstracts?

Hypothetical Example

Screening Studies of Generative AI Feedback in Higher Education

Suppose your review includes empirical studies examining university students' experiences of receiving generative AI-generated feedback on academic work. Studies of school students, teacher-only perspectives, non-generative automated feedback, and non-empirical publications are excluded.

Record A: University students receiving ChatGPT-generated writing feedback The abstract describes undergraduate participants, generative AI-generated feedback, and student interviews about their experiences. Retain. The central eligibility elements appear to fit.
Record B: Secondary-school students receiving generative AI feedback The technology fits, but the abstract clearly identifies high-school students. Exclude if the population criterion is limited to higher education.
Record C: University instructors' perceptions of AI feedback tools The setting and technology appear relevant, but only instructors were studied. Exclude if the review requires evidence about students' experiences.
Record D: Student perceptions of automated formative feedback The abstract identifies university students but does not explain whether the feedback system uses generative AI. Retain for further assessment rather than assuming that “automated” means either generative or non-generative.
Record E: Generative AI and feedback in universities The title sounds ideal, but the abstract reveals that the article is a conceptual commentary with no empirical data. Exclude if primary empirical research is required.

Record D illustrates the most important screening judgment. You do not yet know that it is eligible. You also do not know that it is ineligible. The correct early-stage decision is therefore to preserve the uncertainty and obtain more information.

05 · What Researchers Often Get Wrong

Common Errors During Title and Abstract Screening

Misconception

The Goal Is to Exclude as Many Records as Possible

The goal is accurate selection, not maximum exclusion. Early screening should remove records that can reasonably be judged ineligible while protecting potentially eligible studies from premature rejection.

Misconception

If the Exact Keyword Is Missing, the Paper Is Irrelevant

Authors may describe the same population, intervention, or phenomenon using different terminology. Eligibility depends on the underlying concept and the review criteria, not on whether the abstract reproduces your search vocabulary.

Misconception

If the Abstract Does Not Mention Something, the Study Does Not Have It

Abstracts omit information. When an essential eligibility characteristic is simply unreported, absence of that information should not automatically be interpreted as failure to meet the criterion.

Misconception

You Should Exclude a Paper That Looks Methodologically Weak

Unless methodological features form part of predetermined eligibility criteria, apparent quality is not necessarily an abstract-screening decision. Critical appraisal generally requires more information and serves a different purpose from determining relevance.

Misconception

A Promising Title Is Enough to Include the Study

Title and abstract screening usually identifies records for further assessment rather than establishing final eligibility. A promising record can still fail an essential criterion once the full report is examined.

Misconception

Two Reviewers Should Never Disagree if the Criteria Are Good

Eligibility decisions involve judgment, and disagreement can expose wording that seemed clear in the protocol but operates ambiguously in practice. The appropriate response is to resolve the interpretation consistently rather than quietly allowing different standards to develop.

06 · What This Means for You

Ask Whether You Have Enough Information to Exclude, Not Whether You Have Enough to Include

A useful mental shift can make title and abstract screening both faster and safer.

Instead of asking, “Has this abstract proved that the study belongs in my review?” ask, “Has this record given me enough information to conclude that it does not meet my criteria?”

That framing reflects the provisional nature of early screening. Full eligibility can be established later from more complete information.

A simple decision framework

If the title clearly violates an essential eligibility criterion
Exclude the record without requiring a full-text reading merely to confirm what is already clear.
If the title is vague or potentially relevant
Read the abstract before making the decision.
If the abstract clearly establishes ineligibility
Exclude the record according to the review's screening procedure.
If the abstract appears eligible
Retain the record for the next stage rather than treating abstract screening as final proof of eligibility.
If an essential criterion is unclear or unreported
Retain the record and obtain more information, commonly through full-text assessment.

Once a record survives this stage, the question becomes whether and when you need to retrieve the full text. At that point, you can apply criteria that cannot be evaluated reliably from bibliographic information alone.

For structured reviews, use the criteria consistently rather than making them stricter as the pile grows. Fatigue has yet to be recognized as an eligibility criterion.

07 · A Quick Checklist

What to Check While Screening Each Title and Abstract

For each record, check:
Does the title or abstract clearly identify an eligible or ineligible population?
Is the intervention, exposure, phenomenon, or concept actually the one defined by my review?
Does the setting or context satisfy any boundary that genuinely forms part of my eligibility criteria?
If study design or publication type determines eligibility, can I identify it confidently from the information provided?
Am I distinguishing information that is absent from information that clearly establishes ineligibility?
Am I screening the underlying concepts rather than simply looking for exact keyword matches?
Have I avoided using journal prestige, citation count, or an informal impression of methodological quality as a substitute for my eligibility criteria?
If I am genuinely uncertain, have I retained the record for further assessment rather than guessing?
08 · Frequently Asked Questions

Questions About Screening Titles and Abstracts

Can I exclude a paper based on the title alone?

Yes, when the title clearly establishes that the record violates an essential eligibility criterion. If the title is vague, incomplete, or potentially relevant, examine the abstract before excluding it.

Do all inclusion criteria need to be confirmed in the abstract?

No. Abstracts frequently omit details required for final eligibility assessment. At this stage, a record can remain potentially eligible even when some criteria cannot yet be confirmed. Those criteria can be assessed from the full text or other information later.

What if the abstract does not mention my outcome?

Do not automatically conclude that the outcome was not measured. Abstracts report only selected information. If outcome measurement is an eligibility criterion and the abstract leaves it uncertain, further assessment may be necessary.

Should I read the methods section of the full paper during abstract screening?

Not routinely. The purpose of title and abstract screening is to identify clearly ineligible records and retain potentially eligible ones. If you repeatedly need full-text information to resolve a criterion, that record can usually move to the full-text stage rather than turning initial screening into full-text assessment.

Should I exclude papers with very small samples during abstract screening?

Only if a justified minimum sample requirement is genuinely part of your predetermined eligibility criteria. Otherwise, sample size may be relevant to later methodological appraisal or interpretation rather than initial relevance screening.

What should I do if I am only 60% sure a record is irrelevant?

Do not invent a numerical confidence threshold unless your screening procedure specifies one. The practical question is whether the available information clearly establishes ineligibility. If reasonable uncertainty remains, retaining the record for further assessment is generally safer.

Should two people screen every title and abstract?

It depends on the review methodology. For Cochrane intervention reviews, duplicate independent title and abstract screening is desirable but not mandatory, while final eligibility decisions for potentially eligible studies based on full text require at least two people working independently. Other evidence-synthesis methodologies may specify different procedures.

Should I record a detailed exclusion reason for every abstract I reject?

Not necessarily. In Cochrane reviews, numbers are sufficient for records excluded during initial title and abstract screening, while more explicit exclusion documentation is expected for studies that appeared potentially eligible and were excluded after closer assessment. Follow the reporting requirements appropriate to your review methodology.

09 · The Bottom Line

Look for Enough Evidence to Make the Screening Decision, and Do Not Guess the Rest

The Bottom Line

When screening titles and abstracts, compare each record with your actual eligibility criteria and exclude it only when the available information gives you a defensible reason to do so.

Focus on the population, intervention or phenomenon, context, study design, and other criteria that genuinely define your review. Do not confuse missing information with failed eligibility, and when an abstract leaves an important question unresolved, carry the record forward until you have enough information to decide.

10 · Sources and Further Reading

Authoritative Guidance on Title and Abstract Screening

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes