Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

How Do Participant Burden and Practical Constraints Affect the Choice of Data Collection Method?

A data collection method may fit your research question conceptually but still be inappropriate if it places unreasonable demands on participants or cannot be implemented well. Learn how to balance evidence quality with burden and feasibility.

75
Participant Burden and Data Collection Guide 75 of 217
01 · The Question

What if the best-looking method is too demanding to use well?

You have identified a method that seems to fit your research question. Then practical reality arrives. Participants would need to complete a 45-minute questionnaire, attend two interviews, maintain a diary for several weeks, or permit repeated observations. Recruitment may already be difficult. Your project has limited time, funding, access, equipment, or research assistance.

Should you preserve the method because it appears methodologically ideal, or simplify the design?

Feasibility is not separate from research quality. A method that demands more than participants can reasonably provide may produce refusals, attrition, missing data, rushed responses, or an unrepresentative group willing and able to tolerate the procedure. Likewise, a design that exceeds the research team's capacity may be implemented poorly even if it looks excellent in a proposal.

The relevant question is therefore whether the evidence gained from a data collection procedure justifies the demands it places on participants and the resources required to implement it properly.

02 · The Short Answer

Choose a method you can implement ethically and competently

In Brief

Participant burden and practical constraints should influence data collection because a method is appropriate only if it can obtain adequate evidence while placing reasonable demands on participants and remaining feasible to implement, manage, analyze, and protect ethically.

Do not choose the easiest method regardless of evidentiary fit, but do not pursue an idealized method that is unrealistic either. First identify the evidence you need, then compare defensible ways of obtaining it and reduce unnecessary burden without removing information essential to answering the research question.

03 · What You Need to Know

Feasibility is part of methodological fit

What is participant burden?

Participant burden refers broadly to the demands that research participation places on the people involved. Those demands can include time, effort, inconvenience, cognitive work, emotional discomfort, repeated contact, travel, disruption of ordinary activities, privacy concerns, physical procedures, technological requirements, and other consequences of participating.

Burden is not determined simply by how many minutes a procedure takes. A ten-minute questionnaire about highly sensitive experiences may be more demanding than a longer questionnaire about an ordinary topic. A repeated diary may require only a few minutes at a time but interrupt participants throughout the day. An interview conducted during working hours may create professional inconvenience beyond the interview itself.

The same procedure can also impose different levels of burden on different participants. Researchers should therefore consider the characteristics and circumstances of the population rather than relying only on an abstract estimate of completion time.

Burden matters ethically

Ethical guidance for research involving human participants emphasizes minimizing unnecessary harm and burden while ensuring that the research is scientifically and socially valuable. The Belmont Report, for example, frames beneficence in terms of maximizing possible benefits while minimizing possible harms, while the Declaration of Helsinki requires researchers to consider burdens and risks in relation to the importance of the research.

Not every inconvenience constitutes serious harm, and worthwhile research can legitimately ask participants to invest substantial time or effort. The important question is whether those demands are justified by the research purpose and managed appropriately.

Collecting information that is unnecessary for answering the research question is difficult to justify simply because it might become useful later. Ethical restraint and methodological focus often point in the same direction.

Burden can affect the quality of the data

Participant burden is not only an ethical issue. It can influence who participates and what evidence they provide.

Long or demanding questionnaires can contribute to fatigue, satisficing, item nonresponse, breakoff, or declining response quality. Repeated assessments can lead participants to miss measurement occasions or withdraw. Lengthy interviews can produce fatigue, particularly when questions are cognitively or emotionally demanding.

Researchers should therefore ask whether every question, task, measurement, and follow-up contributes enough evidentiary value to justify its inclusion.

A 60-item questionnaire is not automatically more informative than a 30-item questionnaire. Sometimes it is merely twice as optimistic about the participant's afternoon.

Burden can change who ends up in your sample

A demanding protocol may selectively discourage people with limited time, caregiving responsibilities, accessibility needs, unreliable internet access, demanding employment, health constraints, or other competing obligations.

As a result, the people willing or able to participate may differ systematically from the population the researcher hopes to understand. This can affect the transferability, representativeness, or interpretation of findings depending on the study design.

Researchers should therefore consider not only whether participants can complete the procedure, but who is likely to be excluded by its demands.

Time is only one form of burden

Completion time is easy to quantify, so it often receives disproportionate attention. Other forms of burden may matter just as much.

Potential burden What it can involve Possible design response
Time Long sessions, repeated measurements, travel, waiting Remove nonessential procedures, shorten sessions, reduce unnecessary follow-ups
Cognitive effort Difficult recall, complex instructions, repetitive judgments Simplify wording, shorten recall periods, improve instrument design
Emotional burden Sensitive topics, distressing memories, uncomfortable disclosure Collect only necessary information and use appropriate safeguards and support procedures
Privacy burden Disclosure of sensitive information, monitoring, linkage of records Minimize identifiable collection and justify access to sensitive data
Logistical burden Travel, scheduling, equipment, internet access Offer feasible modes or locations where methodologically appropriate
Repeated-contact burden Diaries, longitudinal surveys, repeated interviews or measurements Justify measurement frequency and avoid redundant contact

Researcher constraints matter too

A method can be manageable for participants while exceeding the research team's capacity. Interviews require scheduling, interviewing skill, preparation of records, analysis, and secure data management. Observation can require prolonged access and substantial field time. Large surveys may require sampling expertise, platform management, follow-up, data cleaning, and appropriate statistical analysis.

Researchers should assess whether they possess the time, expertise, personnel, technology, funding, permissions, and analytical capacity required to execute the proposed method well.

This is not an invitation to choose whichever method is easiest. It is recognition that methodological quality depends partly on implementation. A complex method performed badly is not rescued by the sophistication of its name.

Access can determine whether a theoretically suitable method is realistic

Some evidence requires access that researchers cannot assume they will receive. Classroom observation may require institutional, instructor, participant, or other permissions. Administrative records may be restricted by privacy or governance requirements. Platform logs may require technical access that the research team does not control.

Access should therefore be investigated early rather than treated as a minor logistical detail after the design has been finalized.

If the method depends on evidence you cannot legally, ethically, or practically obtain, the study may need another approach. The question of what to do when the best evidence cannot realistically be collected then becomes central.

Cost can shape the design without determining it

Research resources are finite. Travel, transcription, equipment, participant reimbursement, software, secure storage, research assistance, laboratory procedures, and data access can all affect what is feasible.

Cost should not be used to justify collecting evidence that cannot answer the research question. Instead, it should help researchers compare several defensible approaches. Perhaps remote interviewing can replace travel without materially undermining the research purpose. Perhaps an existing dataset contains suitable evidence and avoids unnecessary new collection. Perhaps fewer but more focused measures can answer the question adequately.

The objective is efficient adequacy, not simply minimum expenditure.

Privacy and intrusiveness can make technically easy data difficult to justify

Digital technologies can make some forms of data collection technically effortless. A platform may record clicks, locations, timestamps, messages, or other traces automatically. That availability does not mean all recorded information should be collected for research.

Researchers should consider what participants reasonably expect, whether the information is sensitive, what permissions and consent requirements apply, whether less intrusive evidence could answer the question, and how data will be protected.

Automatically generated data can also create a misleading sense that participant burden is zero. Participants may not spend time completing an instrument, but privacy risks and concerns about surveillance or secondary use can still be consequential.

Do not solve burden by removing the evidence the question requires

Reducing burden is desirable only until the procedure remains capable of answering the research question.

Suppose a validated scale contains multiple items because the construct cannot be measured adequately with one convenient question. Replacing it with a single improvised item merely to shorten the questionnaire may reduce participant time while damaging measurement quality.

Likewise, shortening an interview from 60 minutes to ten minutes may be sensible for a focused question but inadequate for a study requiring detailed life histories or complex experiential accounts.

The design challenge is therefore to remove unnecessary burden, not necessary evidence.

Consider burden when choosing between otherwise defensible methods

Once you have identified data collection methods capable of answering the research question, burden and feasibility can help distinguish among them.

If two methods provide sufficiently appropriate evidence but one requires considerably less participant time, intrusion, cost, or logistical complexity, the less burdensome option may be preferable. If the more demanding method provides uniquely important evidence, the additional burden may be justified.

This comparison is more defensible than beginning with convenience and asking the research question to adapt afterward.

Complex designs multiply practical demands

Adding sources or methods can create cumulative burden. Participants may complete a questionnaire and then be interviewed. Teachers may be interviewed, observed, and asked to maintain logs. Longitudinal designs may contact the same people repeatedly.

Each component may appear reasonable in isolation while the combined protocol becomes excessive. Researchers should therefore evaluate the total participation experience rather than approving each procedure mentally one at a time.

This is particularly important because more sources or methods do not automatically produce stronger evidence. Additional burden requires an additional methodological justification.

04 · A Practical Example

When an ambitious data collection plan becomes unnecessarily burdensome

Hypothetical Example

Studying faculty adoption of generative AI

A researcher wants to understand how faculty members decide whether to use generative AI in teaching. The original protocol asks participants to complete a 25-minute questionnaire, participate in a 90-minute interview, maintain a two-week diary, and attend a focus group.

Return to the question The central question concerns how faculty members make decisions about AI use, including the considerations and experiences shaping those decisions.
Examine each component The interview provides detailed evidence directly relevant to decision-making. The diary could add value if decisions need to be examined as they occur over time. The questionnaire may provide useful participant characteristics, but many additional items are unrelated to the central question. The focus group largely repeats issues already explored individually.
Assess cumulative burden Participants would commit several hours across multiple contacts. Faculty with the greatest workloads may be especially unlikely to participate or remain in the study.
Redesign The researcher retains focused interviews, shortens the background questionnaire to information actually needed, and uses diaries only if temporal decision processes are central enough to justify them. The redundant focus group is removed.
Result The revised design still collects the evidence necessary for the question while reducing unnecessary demands on participants and the research team.

The methodological improvement came from removing procedures that contributed little, not from making the study easier at any cost.

05 · What Researchers Often Get Wrong

Common misconceptions about feasibility and participant burden

Misconception

“Participant burden just means how long the study takes”

No. Time matters, but burden can also involve cognitive effort, inconvenience, privacy, emotional discomfort, repeated contact, travel, technological requirements, disruption of routine, and other demands. The same procedure can also affect participants differently.

Misconception

“If participants consent, the burden is acceptable”

Consent does not remove the researcher's responsibility to design a proportionate procedure and minimize unnecessary burden or risk. Participants agreeing to a demanding protocol does not make every demand methodologically or ethically necessary.

Misconception

“Longer instruments produce better data”

Not automatically. Additional items can improve measurement when they are necessary and well designed, but unnecessary length can contribute to fatigue, missing responses, breakoff, or reduced attention. Every item should have a defensible purpose.

Misconception

“Digital data collection has no participant burden”

No. Automated collection may reduce participants' active time, but privacy, monitoring, data linkage, technological access, and expectations about secondary use can still create important burdens and ethical considerations.

Misconception

“Practical constraints are just weaknesses I should hide”

No. Feasibility is part of research design. Researchers should make reasoned choices within real constraints and report consequential limitations transparently. Pretending that resources and access do not shape research usually produces less credible methodology, not more.

Misconception

“The least burdensome method is always the most ethical choice”

No. A very easy procedure that cannot answer the research question wastes participant contributions and research resources. Ethical design requires both proportionate burden and sufficient scientific or scholarly value.

06 · What This Means for You

Design for sufficient evidence with the least unnecessary burden

Once you know what evidence is necessary, audit every element of the proposed collection process. Ask what would be lost if an item, session, measurement occasion, participant group, or method were removed.

A simple decision framework

If a procedure collects information that is not necessary for the research question or analysis
Remove it unless another clear and ethically justified research purpose exists.
If two defensible methods provide sufficiently similar evidence
Consider the method that imposes less burden and can be implemented more competently.
If the more burdensome method provides uniquely important evidence
Retain it when the evidentiary gain justifies the additional demand and appropriate safeguards are possible.
If repeated measurements are planned
Justify the frequency and consider the cumulative burden across the entire participation period.
If access, cost, expertise, privacy, or time makes the preferred method unrealistic
Evaluate a defensible alternative or reconsider the scope of the question rather than implementing the preferred method badly.

Also revisit the broader trade-offs among depth, breadth, standardization, and flexibility. A feasible design may require fewer participants with deeper collection, broader coverage with a shorter instrument, or a more focused question that can be answered properly with available resources.

Feasibility should constrain ambition before poor implementation constrains the credibility of the findings afterward.

07 · A Quick Checklist

Before finalizing a demanding data collection protocol

Audit both participant and researcher burden:
Estimate the total time participants will spend across all recruitment, collection, and follow-up activities.
Consider cognitive, emotional, privacy, logistical, technological, and repeated-contact burdens in addition to time.
Ask whether the procedure may systematically discourage particular members of the population from participating or remaining in the study.
Remove questions, measures, and collection occasions that do not contribute meaningfully to the research question or planned analysis.
Verify that shortening the procedure does not remove evidence necessary to measure important constructs adequately.
Confirm access, permissions, equipment, staffing, researcher expertise, funding, secure storage, and analytical capacity before committing to the method.
Assess the cumulative burden created when several sources or methods are combined.
Verify the ethical and institutional requirements applicable to the specific procedures and participant population.
08 · Frequently Asked Questions

Frequently asked questions about participant burden and feasibility

What counts as participant burden in research?

Participant burden can include time, effort, inconvenience, cognitive demands, emotional discomfort, privacy concerns, travel, repeated contact, technological requirements, disruption of routine, and other demands created by research participation. Its significance depends on the procedure and participant population.

How long is too long for a research survey?

There is no universal maximum that applies to every survey and population. Appropriate length depends on the topic, participants, mode, complexity, incentives, importance of the research, and necessity of the items. Pilot testing and completion data can help researchers evaluate burden in the intended context.

Can participant fatigue affect data quality?

Yes. Demanding or repetitive procedures can contribute to reduced attention, satisficing, missing responses, breakoff, or attrition. The extent depends on the task and context, so researchers should minimize unnecessary demands and evaluate instruments before full deployment.

Should I shorten a validated scale to reduce burden?

Not casually. Removing items can change the measurement properties and validity of score interpretations. Use an established short form when appropriate or obtain evidence that a modified version remains suitable for the intended purpose rather than assuming fewer items measure the same construct equally well.

Are practical constraints legitimate reasons to change a research design?

Yes. Access, funding, time, expertise, ethics, privacy, recruitment, and participant burden are legitimate design considerations. The revised design must still provide evidence adequate for the research question, or the question and intended claims should be adjusted accordingly.

Does paying participants eliminate concerns about burden?

No. Appropriate compensation can recognize participants' time and inconvenience, but it does not make unnecessary, disproportionate, or poorly designed procedures acceptable. Compensation and participant burden are related ethical considerations, not substitutes for one another.

Should I use existing data to reduce participant burden?

Consider it when existing data provide appropriate evidence and their use is ethically and legally permissible. Avoiding unnecessary new collection can reduce burden, but existing data should not be used merely for convenience when they cannot adequately answer the research question.

09 · The Bottom Line

A method has to work in the real study, not only on paper

The Bottom Line

Participant burden and practical constraints should shape data collection because an appropriate method must provide sufficient evidence while remaining proportionate for participants and feasible for the research team to implement competently and ethically.

Start with the evidence the question requires, then remove unnecessary demands and compare feasible alternatives. Do not sacrifice essential evidence merely to make participation easier, but do not collect information simply because an ambitious protocol permits it. The defensible design is the one that obtains what the study genuinely needs without asking participants or researchers to do more than the evidence justifies.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes