Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Can Study Procedures Unintentionally Exclude Certain Participants?

Participants can meet every eligibility criterion and still be effectively excluded by how a study operates. Scheduling, location, technology, communication, cost, and study burden can all become unintended selection mechanisms.

107
When Study Procedures Exclude Participants Guide 107 of 217
01 · The Question

Can Someone Be Eligible for a Study but Still Have No Realistic Way to Participate?

A research protocol may have carefully justified inclusion and exclusion criteria. Yet an eligible participant might still need to travel two hours to the study site, attend appointments during working hours, use an unfamiliar app, complete lengthy forms, communicate in a particular language, or return for repeated visits.

None of these requirements necessarily appears under “exclusion criteria.” Together, however, they can determine who is actually able to enroll and remain in the study.

This is why participant selection does not end with eligibility. Study procedures can function as informal filters when the practical demands of participation are easier for some eligible people to meet than others.

02 · The Short Answer

Procedures Can Create Exclusion Even Without an Exclusion Criterion

In Brief

Study procedures can unintentionally exclude participants when otherwise eligible people cannot realistically complete recruitment, consent, travel, scheduling, technology, communication, measurement, or follow-up requirements that are not essential to the research question.

Not every participation requirement can or should be removed. Researchers should distinguish scientifically necessary procedures from logistical defaults and examine whether reasonable alternatives can reduce barriers without compromising safety, measurement, intervention fidelity, or study validity.

03 · What You Need to Know

The Protocol Is Not the Only Thing That Determines Who Participates

Formal eligibility tells researchers who may participate. Study procedures help determine who can participate in practice.

This distinction matters because a final sample is produced through several filters. People must learn about the study, respond to recruitment, complete screening, understand consent, reach the study procedures, meet participation demands, and remain involved long enough to contribute the required data.

Barriers at any of those stages can change who ultimately gets included in the evidence.

Scheduling Can Select Participants by Availability

A study that operates only between 9:00 a.m. and 4:00 p.m. on weekdays may be easy to attend for some participants and nearly impossible for others. People with inflexible employment, classes, caregiving responsibilities, medical appointments, or limited transportation options may have fewer opportunities to participate.

The result can be selection based partly on schedule flexibility, even though flexibility has nothing to do with the formal research question.

Where scientifically feasible, evening appointments, weekend sessions, broader scheduling windows, asynchronous procedures, or fewer required visits may reduce this barrier.

Location Can Turn Distance Into a Selection Mechanism

Centralizing research at one hospital, university, laboratory, or clinic may be necessary because of equipment, staffing, safety, or intervention requirements. But location can also narrow participation.

Travel time, transportation availability, parking, mobility, cost, weather, and the need to arrange assistance can affect who reaches the site. These barriers may become particularly important when multiple visits are required.

Remote or decentralized procedures can sometimes help, but they should not be treated as universally superior. A remote alternative may require reliable connectivity, devices, digital skills, and privacy at home. Researchers need to compare barriers rather than simply replacing one mode with another.

Technology Requirements Can Exclude People Who Are Otherwise Relevant

Digital research methods can expand participation dramatically. Online surveys, videoconferencing, mobile applications, wearable devices, electronic consent, and remote data collection can reduce travel and allow geographically dispersed recruitment.

They can also introduce a digital participation threshold.

A participant may need a recent smartphone, a particular operating system, reliable broadband, sufficient data allowance, an email address, familiarity with digital interfaces, or software compatible with assistive technologies. When these requirements are unrelated to the phenomenon under investigation, the study may unintentionally select participants partly by technological access and proficiency.

Alternative participation modes, loaned devices, technical assistance, telephone options, or accessible platforms may sometimes reduce these barriers. Researchers should evaluate whether changing mode affects measurement or intervention delivery.

Participant Burden Accumulates Across Procedures

A single 20-minute questionnaire may seem modest. Add screening, consent, baseline measures, repeated surveys, travel, interviews, diaries, biological samples, device setup, reminders, and follow-up visits, and participation can become substantially more demanding.

Burden includes more than time. Participants may experience physical effort, fatigue, discomfort, cognitive demands, emotional strain, privacy concerns, travel, disruption of work or caregiving, and technological effort.

Researchers often evaluate each procedure separately during protocol development. Participants experience the study cumulatively.

This means that even individually reasonable procedures can combine into a design that disproportionately discourages or excludes people with fewer available resources, poorer health, demanding schedules, or accessibility needs.

Communication Procedures Can Create Invisible Barriers

Dense recruitment advertisements, technical consent forms, complex instructions, telephone-only contact, inaccessible PDFs, or communication through only one language can determine who successfully moves through the research process.

Communication should therefore be evaluated as part of the study procedure rather than as packaging around the “real” research.

Language deserves particular attention because language requirements can effectively exclude populations even when the formal eligibility criteria never mention language.

Standardization and Accessibility Can Sometimes Be in Tension

Research procedures often need consistency. Standardized administration can reduce unwanted measurement variation and ensure that participants receive comparable interventions or assessments.

Yet standardization should not automatically mean that every incidental procedural detail must remain identical.

Suppose a questionnaire measures attitudes and is normally completed while seated in a research office. Allowing an eligible participant to complete the same questionnaire using accessible technology may preserve the construct while removing a barrier. By contrast, providing assistance on a test intended specifically to measure unaided performance could change what is being measured.

The appropriate question is not “Was the procedure identical?” but “Did the adaptation alter a feature essential to the intended measurement, intervention, or inference?”

Compensation Does Not Automatically Remove Financial Barriers

A study may compensate participants while still imposing costs they cannot readily absorb. Transportation, parking, childcare, internet data, meals, and lost wages can occur before reimbursement is received or exceed what the study covers.

Researchers should distinguish participant compensation from reimbursement of study-related expenses according to the policies applicable to their setting. Ethical and institutional requirements concerning payment vary.

From a sampling perspective, however, the concern is straightforward: if participation requires people to absorb meaningful costs, the study may become more accessible to those with greater financial flexibility.

Repeated Procedures Can Affect Retention as Well as Recruitment

Unintended exclusion can occur after enrollment. Participants who initially manage the study requirements may later miss visits, stop completing assessments, or withdraw.

If attrition is related to participant characteristics or barriers, the analyzed sample can become different from the enrolled sample. A demanding follow-up schedule, for example, may disproportionately lose participants with unstable employment, transportation difficulties, caregiving responsibilities, or health limitations.

Researchers should therefore examine not only who enrolls but who remains through each important stage of the study.

Procedural Barriers Can Contribute to Underrepresentation

If the same barriers disproportionately affect particular populations, the final sample may contain less information about them. Over many studies, such patterns can contribute to persistent underrepresentation in the evidence base.

The National Academies has identified study-level barriers such as inconvenient locations, lengthy visits, missing work, transportation, childcare, and other participation demands as factors that can impede recruitment and retention in clinical research. FDA guidance has similarly encouraged approaches that can reduce burdens and improve enrollment in clinical trials.

These sources arise from health research, but the design principle is applicable more broadly: procedures influence the population that can realistically participate.

Researchers Should Distinguish Essential Procedures From Historical Defaults

A procedure can persist simply because “that is how the study has always been done.” Participants travel to the university because researchers work there. Interviews occur during office hours because that is when staff are present. A paper form is used because the previous project used one.

None of these reasons necessarily makes the procedure inappropriate. But they should not be mistaken for scientific necessity.

Essential requirement A feature necessary for the research question, participant safety, intervention fidelity, measurement validity, or another substantive study requirement.
Procedural default A feature arising primarily from how the research team has chosen or traditionally organized the study.

Procedural defaults are often where accessibility improvements are easiest to find.

Participant Input Can Reveal Barriers Researchers Do Not Notice

Researchers are unusually familiar with their own procedures. That familiarity can make confusing instructions, inaccessible platforms, difficult travel, or burdensome scheduling seem more manageable than they are to participants.

Pilot testing, participant advisory groups, community engagement, accessibility review, and consultation with people who have relevant lived experience can reveal barriers before full recruitment begins.

This is especially useful when researchers are trying to make research participation more accessible without compromising the study's scientific purpose.

Watch Out

Do not assume that a procedure is neutral merely because every participant is asked to do the same thing. An identical requirement can impose very different burdens depending on participants' circumstances, resources, disabilities, location, language, or responsibilities.

04 · A Practical Example

How a Study With Broad Eligibility Can Still Recruit a Narrow Sample

Hypothetical Example

A study of working adults' experiences with workplace stress

Researchers invite employed adults from across a metropolitan area to participate in interviews about workplace stress. The eligibility criteria are intentionally broad, with no restrictions based on occupation, income, disability, or employment schedule.

Eligibility Most employed adults in the target area can theoretically participate.
Study procedure Interviews take place only at the university between 10:00 a.m. and 3:00 p.m. on weekdays and last approximately 90 minutes.
Practical effect People with flexible schedules, remote work, paid leave, or convenient transportation may find participation substantially easier than workers with fixed shifts or limited leave.
Methodological irony Workers experiencing some of the conditions most relevant to workplace stress may be among those least able to attend.
Redesign Researchers add evening and weekend interviews and offer an appropriate remote option while keeping the interview protocol consistent.
Interpretation Broad eligibility becomes more meaningful because the practical route into the study better aligns with the population the researchers intend to understand.

The eligibility criteria were never the main problem. The procedure had created an additional, unintended layer of selection.

05 · What Researchers Often Get Wrong

Common Mistakes When Evaluating Study Procedures

Misconception

If Everyone Faces the Same Procedure, the Procedure Is Fair

Identical requirements can impose unequal burdens. A weekday appointment, digital platform, long journey, or lengthy session may be trivial for one participant and prohibitive for another. Researchers should examine access as well as procedural consistency.

Misconception

Participant Exclusion Happens Only During Eligibility Screening

People can be effectively excluded during recruitment, consent, scheduling, travel, data collection, follow-up, or retention. Selection continues after eligibility has been determined.

Misconception

Remote Procedures Solve Accessibility Problems

Remote participation can reduce travel and scheduling barriers but create others involving devices, connectivity, digital literacy, privacy, and accessible technology. The appropriate mode depends on the population and procedure.

Misconception

Changing a Procedure Always Threatens Study Validity

Some procedural features are essential, while others are incidental. Researchers should identify which features affect the construct, intervention, safety, or inference before assuming that every adaptation compromises standardization.

Misconception

If Recruitment Targets Are Met, Procedural Barriers No Longer Matter

A study can reach its numerical target while systematically recruiting people for whom participation is easiest. Sample size does not reveal whether relevant segments of the population encountered greater barriers or were lost during follow-up.

06 · What This Means for You

Audit the Demands of Participation Before Recruitment Begins

List what a participant must actually do from first contact through the final follow-up. For each requirement, ask why it exists and what happens if it changes.

A simple decision framework

If a procedure is essential to safety, measurement, intervention fidelity, or the research question
Retain the essential feature and consider whether participants can be supported in completing it.
If a requirement exists mainly for researcher convenience
Consider alternative schedules, locations, modes, formats, or workflows that preserve the scientific objective.
If an alternative mode changes how data are collected
Assess whether mode affects measurement comparability and document or account for it where necessary.
If particular populations repeatedly fail to enroll or remain in the study
Investigate where they are being lost in the participation pathway rather than assuming lack of interest.
If an unavoidable procedure substantially narrows participation
Recognize the resulting population boundary and limit interpretation accordingly.

Procedural review should complement, rather than replace, examination of formal inclusion and exclusion criteria. A study can have appropriate eligibility criteria and inaccessible procedures, or accessible procedures built around an unnecessarily restricted eligible population. Both layers matter.

07 · A Quick Checklist

Before Launching the Study, Check the Participant Journey

Before recruitment and data collection, check:
Map what participants must do from recruitment through screening, consent, participation, and follow-up.
Identify which procedural requirements are scientifically essential and which primarily reflect logistical convenience.
Review scheduling, visit frequency, duration, location, transportation, and waiting time for avoidable barriers.
Check whether digital platforms, devices, connectivity requirements, and electronic materials are usable by the relevant participant population.
Evaluate communication, language, literacy, and accessibility requirements throughout the study rather than only during consent.
Calculate cumulative participant burden rather than assessing every procedure in isolation.
Consider direct and indirect participation costs and applicable reimbursement or compensation arrangements.
Pilot procedures with people who can identify barriers the research team may not notice.
Track who enrolls, declines, withdraws, or is lost to follow-up when those data can ethically and appropriately inform recruitment and retention.
Report consequential procedural barriers that limit who the study was realistically able to include.
08 · Frequently Asked Questions

Questions About Study Procedures and Participant Exclusion

How can a study procedure exclude someone who is eligible?

An eligible person may still be unable to meet requirements involving travel, scheduling, technology, language, accessibility, cost, time, communication, or repeated follow-up. These demands can function as practical selection criteria even when they are absent from the formal eligibility list.

Should researchers change standardized procedures to improve access?

Only when the change preserves what the study needs to measure or deliver. Researchers should identify which features are essential to validity, safety, or intervention fidelity and which can be adapted without changing the scientific meaning of the procedure.

Are long study visits a source of selection bias?

They can contribute to selection when the burden makes participation systematically less feasible for certain eligible people. Whether that materially affects the study depends on who is deterred or lost and whether those differences are relevant to the research question or intended inference.

Is offering online participation always better?

No. Online participation can reduce geographic and transportation barriers while introducing requirements involving connectivity, devices, digital literacy, privacy, and accessible software. Multiple modes may sometimes improve access when they remain scientifically appropriate.

Can participant burden affect research results?

Yes. Burden can influence who enrolls, who remains in the study, which procedures are completed, and which data are missing. If these patterns are related to characteristics or outcomes relevant to the research, they can affect interpretation.

How can I identify barriers before the study starts?

Map the participant journey, conduct accessibility review, pilot recruitment and procedures, and seek input from people with relevant lived experience or community knowledge. These approaches can reveal barriers that are not obvious from the research team's perspective.

09 · The Bottom Line

Eligibility Means Little if Participation Is Not Realistically Possible

The Bottom Line

Study procedures can unintentionally exclude relevant participants when scheduling, location, technology, communication, cost, accessibility, or cumulative burden makes participation substantially harder for some eligible people than others.

Audit the entire participant journey and distinguish procedures required by the science from procedures inherited from convenience. When barriers can be removed without changing the research question, safety, measurement, or intervention, redesigning the procedure can broaden participation without weakening the study.

10 · Sources and Further Reading

Sources on Study Procedures and Participation Barriers

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes