03 · What You Need to Know
Understanding Scientific Value, Participant Burden, and Ethical Proportionality
What Makes a Study Scientifically Valuable?
Scientific value concerns the potential of research to produce credible knowledge that addresses a meaningful question, improves understanding, evaluates an important proposition, or contributes to methodological development.
It depends partly on whether the research question is worthwhile and whether the proposed methods can generate evidence capable of answering it.
A study does not become scientifically valuable simply because it collects a large dataset, employs sophisticated statistical techniques, or requires substantial participant effort.
For example, administering five highly similar questionnaires may produce more observations without meaningfully improving the interpretation of a construct. Additional data collection must be justified by its contribution to the research objective.
The CIOMS International Ethical Guidelines identify scientific and social value as important ethical requirements for health-related research. Scientific validity matters because exposing people to burdens for research incapable of generating useful knowledge is difficult to justify.
Although particular requirements differ across research domains, the underlying concern is relevant to educational research, social science, and other forms of human-participant investigation.
What Counts as Participant Burden?
Participant burden refers to the demands that research participation places on individuals. These demands extend beyond physical risk or psychological distress.
Burden may include the time required to complete instruments, travel to research locations, schedule interviews, remember past experiences, learn unfamiliar technologies, or repeatedly respond to similar questions.
It can also include indirect costs. A participant may lose paid working hours, need childcare, use personal mobile data, or rearrange responsibilities to attend research activities.
Some burdens are primarily practical, while others overlap with risks to privacy, welfare, or social relationships.
| Type of burden |
Research example |
Possible ethical concern |
| Time |
Completing a 90-minute questionnaire. |
Excessive time commitment relative to the information obtained. |
| Cognitive effort |
Repeatedly answering complex questions requiring substantial recall. |
Mental fatigue and reduced response quality. |
| Emotional effort |
Recounting experiences of discrimination during multiple interviews. |
Distress, exhaustion, or unwanted recollection. |
| Financial cost |
Traveling repeatedly to a research site. |
Lost income or out-of-pocket expenses. |
| Technological demands |
Installing an application and submitting daily digital diaries. |
Data costs, device limitations, and additional privacy exposure. |
| Social disruption |
Attending research sessions during family or employment obligations. |
Interference with ordinary responsibilities. |
These categories are not mutually exclusive. A lengthy interview may impose time, emotional, and financial burdens simultaneously.
Researchers should evaluate the actual experience of participation rather than assess each instrument in isolation.
Why Participant Burden Is Not Identical to Research Risk
Burden and risk overlap, but they are analytically distinguishable.
Risk concerns the possibility of harm, including its likelihood and severity. Burden concerns the demands, costs, or inconveniences associated with participation, some of which may occur predictably rather than probabilistically.
For example, a two-hour interview imposes a known time commitment. Whether it causes substantial emotional distress is a separate question involving uncertainty.
The Declaration of Helsinki explicitly addresses both risks and burdens in its ethical framework for medical research involving human participants.
This distinction helps researchers avoid overlooking predictable demands simply because a study is classified as low risk.
Participant burden
The effort, inconvenience, time, expense, or other demands associated with taking part in research.
Research risk
The possibility that participation will produce adverse consequences, considered in terms of their likelihood and seriousness.
A study may involve minimal physical danger while imposing considerable time and cognitive demands. Both deserve ethical consideration.
Why Should Researchers Assess Cumulative Burden?
A procedure that seems reasonable on its own may become excessive when combined with other requirements.
Consider a longitudinal study involving a short daily diary, a weekly questionnaire, monthly interviews, and passive activity monitoring. Each component may appear manageable when described separately.
However, the cumulative commitment may interfere with participants' schedules, increase fatigue, and contribute to withdrawal or incomplete data.
Researchers should therefore estimate the total participation requirement across the study rather than report only the duration of individual sessions.
This is especially important in longitudinal studies, repeated-measures designs, clinical trials, intensive experience-sampling studies, and educational interventions involving ongoing student participation.
Burden may also vary over time. A survey administered during an ordinary teaching week may be manageable but substantially more disruptive during examinations.
Can More Data Collection Actually Weaken Scientific Value?
Yes. Additional measurement does not always produce better evidence.
Long questionnaires may encourage careless responses, skipped items, or premature withdrawal. Repeated assessments may also change the behavior being measured, particularly when participants become increasingly aware of the research focus.
These consequences are not inevitable. Intensive longitudinal methods can be scientifically appropriate when frequent observations are necessary to understand change or variability.
The methodological question is whether the additional observations provide information that justifies their cost.
Researchers should consider measurement validity, redundancy, respondent fatigue, missing-data mechanisms, and the feasibility of maintaining participation over time.
Reducing unnecessary burden may improve data quality, although excessive simplification can introduce its own methodological limitations.
How Do You Determine Whether an Additional Procedure Is Necessary?
Every substantial research procedure should have an identifiable purpose connected to the research question or a justified methodological requirement.
Before adding an instrument, researchers should determine what information it will provide, whether that information is already available, and how it will affect the analysis or interpretation.
For example, collecting weekly learning diaries may be justified when the study examines changes in learning strategies over time. If the study concerns only students' overall perceptions at the end of a semester, weekly diaries may be unnecessary unless they address an additional methodological objective.
The justification should be specific. Statements such as "more data will improve reliability" are insufficient without explaining which aspect of measurement or inference is expected to improve.
Researchers should also examine whether existing administrative records, shorter validated instruments, or less frequent observations could answer the question adequately.
Why Does the Same Burden Affect Participants Differently?
A 30-minute questionnaire does not necessarily impose the same burden on every participant.
Someone balancing employment, caregiving, and education may experience greater opportunity costs than someone with a flexible schedule. Participants with disabilities may require accessible formats or additional time. Limited internet access may make digital participation expensive or unreliable.
These differences do not justify automatically excluding people whose participation requires accommodation.
Instead, researchers should consider flexible scheduling, accessible materials, alternative response formats, reasonable reimbursement, and other measures that reduce unequal burdens.
The Belmont Report's principle of justice is relevant because it directs attention to the fair distribution of research burdens and benefits.
When a study disproportionately recruits people with limited resources because they are readily available, researchers should examine whether convenience is producing an unfair distribution of participation demands.
Does Participant Compensation Make a Heavy Burden Acceptable?
Compensation may recognize participants' time, reimburse expenses, and reduce financial barriers to participation. However, payment does not automatically justify excessive or unnecessary procedures.
Researchers should distinguish reimbursement for actual expenses from compensation for time or inconvenience and from incentives intended to encourage enrollment.
The CIOMS guidelines address reimbursement and compensation while emphasizing the importance of avoiding inappropriate influence on participation decisions.
A substantial payment may be ethically acceptable in some contexts, but researchers must consider whether participants can still make a voluntary decision and whether the study's risks and burdens are independently justified.
Payment should not be used as a substitute for improving an unnecessarily demanding research design.
Can Participants Decide for Themselves Whether the Burden Is Worthwhile?
Participant preferences are ethically significant. Individuals may reasonably value the opportunity to contribute to research and accept inconvenience that another person would decline.
Researchers should communicate participation requirements accurately, including the expected duration, frequency of activities, foreseeable burdens, and conditions for withdrawal.
However, informed consent does not eliminate the researcher's responsibility to justify the procedures being requested.
A participant's willingness to complete an unnecessarily repetitive questionnaire does not make the repetition scientifically useful.
Similarly, investigators should avoid paternalistic restrictions on participation when the burden is reasonable and participants can make informed decisions.
The appropriate approach respects individual preferences within a study whose demands have already been ethically and scientifically assessed.
When Does Scientific Value No Longer Justify Participant Burden?
There is no universal number of minutes, survey items, interviews, or research visits that determines when burden becomes excessive.
The answer depends on the study's objectives, participants' circumstances, the importance of the information collected, available alternatives, and the ethical requirements governing the research.
A demanding procedure may be justified when it is necessary to answer a consequential question and appropriate safeguards are available. A much shorter procedure may be difficult to justify if it collects information unrelated to any defensible research objective.
Researchers should also consider whether the study is likely to generate interpretable evidence. An underpowered or poorly designed investigation may impose burdens without a credible prospect of answering its question.
The broader problem of avoiding all research risk at the expense of socially valuable knowledge should not be confused with accepting unnecessary participant demands.
Scientific importance strengthens the case for conducting worthwhile research, but it does not excuse inefficient or unjustified procedures.
04 · A Practical Example
Is an Intensive Semester-Long Learning Analytics Study Worth the Participant Burden?
Hypothetical Example
Studying self-regulated learning among university students
A research team plans a 12-week mixed-methods study examining how students regulate their learning in asynchronous online courses.
The initial protocol requires each participant to complete a 15-minute weekly questionnaire, a 10-minute daily learning diary on five days each week, and two 45-minute interviews.
The researchers also intend to analyze learning management system activity records, subject to appropriate permissions and privacy protections.
Before submitting the protocol for ethics review, the team calculates the expected participation commitment.
The calculation shows the expected direct participation time, not an ethical threshold. It does not establish that 14.5 hours is necessarily unacceptable.
However, it prompts the team to examine whether every procedure is essential.
Map procedures to research questions.
The researchers determine that the weekly questionnaire measures perceived strategy use, while diaries capture variation in learning behavior. Some questionnaire items substantially overlap with the diaries.
Evaluate the required observation frequency.
The team determines that collecting diaries on three strategically selected days each week may adequately address the planned within-week comparisons, although this reduces coverage of other days.
Reduce redundant measurement.
The weekly questionnaire is shortened to 10 minutes after reviewing item relevance and considering the consequences for construct coverage.
Recalculate the expected commitment.
Revised questionnaires require 120 minutes, diaries require 360 minutes, and interviews remain at 90 minutes. The total becomes 570 minutes, or 9.5 hours.
Assess the methodological trade-off.
The team evaluates whether reduced diary frequency affects its ability to estimate temporal patterns and whether the shorter questionnaire retains adequate validity for its intended use.
The revised design reduces direct participation time by five hours, approximately 34.5% of the original estimate.
That reduction is useful only if the revised measurements remain sufficient for the study's intended inferences. The team should justify the sampling schedule and instrument changes rather than assume that a shorter protocol is automatically better.
The example illustrates how participant burden can be examined quantitatively while the final ethical decision still requires methodological judgment and attention to participants' circumstances.
