03 · What You Need to Know
Research Priority Is Both an Evidence Question and a Value Judgment
Experts Can Assess Evidence, but Evidence Does Not Choose Priorities by Itself
Researchers bring essential expertise to priority setting. They can assess what is already known, distinguish an important knowledge gap from a merely unexplored topic, identify methodological limitations, judge whether a question is researchable, and estimate what kind of contribution a proposed study could make.
That expertise matters. A priority-setting process that ignores the literature could devote resources to questions already answered adequately or to studies incapable of resolving the uncertainty they claim to address.
But evidence alone cannot determine what deserves priority. Suppose two problems are both scientifically researchable. One affects many people modestly, while another affects a small population severely. Deciding how much weight to assign severity relative to prevalence requires more than technical expertise. It involves judgments about which consequences and distributions of benefit should matter most.
People Affected by a Problem Know Things Researchers May Not
People living with or directly experiencing a problem may identify burdens, outcomes, trade-offs, and priorities that are difficult to recognize from publications or administrative datasets alone.
For example, researchers may focus on an outcome that is easy to measure while affected people consider a different outcome far more consequential. A technically effective intervention may impose burdens that researchers underestimate. A problem appearing minor in aggregate data may have substantial consequences in everyday life.
This is one reason the question of who a research problem actually matters to cannot be separated completely from the question of who participates in setting priorities.
Stakeholder Involvement Is Already Built Into Major Priority-Setting Frameworks
Contemporary priority-setting frameworks commonly recognize that relevant stakeholders should participate rather than leaving the entire process to researchers alone.
WHO's guidance on the ethics of health research priority setting describes fair priority setting as requiring meaningful stakeholder engagement, particularly because research priorities distribute scarce potential benefits and burdens. WHO's systematic approach to research priority setting similarly includes stakeholder mapping, representation, consultation, and consensus-building as components of the process.
The James Lind Alliance provides another well-developed model. Its Priority Setting Partnerships bring patients, carers, and clinicians together to identify and prioritize unanswered questions about health and care. The underlying logic is that research agendas should reflect uncertainties important to those who experience and address the problem, not only questions generated within academic communities.
Different Stakeholders Contribute Different Kinds of Knowledge
| Stakeholder |
Distinctive Contribution to Priority Setting |
| Researchers |
Knowledge of existing evidence, theory, methods, uncertainty, feasibility, and potential scientific contribution. |
| Affected people and communities |
Lived experience of the problem, its consequences, meaningful outcomes, burdens, priorities, and acceptable trade-offs. |
| Practitioners and professionals |
Knowledge of operational realities, recurring problems, implementation constraints, and evidence needs arising in practice. |
| Policymakers and decision-makers |
Knowledge of policy choices, institutional constraints, population-level responsibilities, and evidence required for decisions. |
| Funders |
Responsibility for allocating limited resources according to a mission, portfolio, expected benefit, and strategic priorities. |
| Methodological and technical experts |
Assessment of whether proposed questions can be investigated credibly and what evidence would be required. |
These contributions overlap, and individuals can occupy several roles. A clinician may also be a patient, a researcher may also be a practitioner, and a community member may possess substantial technical expertise. The categories are useful for identifying perspectives, not for assigning people to rigid boxes.
Affected Communities Should Have Meaningful Influence, Not Decorative Participation
Inviting stakeholders into a priority-setting exercise does not guarantee that they influence the outcome. A process can technically include patients, students, teachers, community members, or practitioners while allowing experts or institutions to define the agenda, terminology, criteria, and final ranking in advance.
Meaningful involvement requires more than attendance. Participants need a genuine opportunity to identify problems, question assumptions, introduce priorities that researchers did not anticipate, understand how decisions are being made, and see how their contributions affect the outcome.
PCORI provides an institutional example of this principle through its emphasis on meaningful engagement of patients and other healthcare stakeholders throughout research. Its engagement framework treats lived experience and stakeholder expertise as relevant to decisions about what and how research should be conducted.
Watch Out
Do not describe a priority-setting process as participatory merely because representatives of affected groups were consulted. Ask who defined the choices, who controlled the criteria, whose knowledge was treated as authoritative, and who ultimately had decision-making power.
But Lived Experience Does Not Replace Scientific Evaluation
The case for stakeholder involvement should not be turned into the opposite extreme. Direct experience of a problem does not necessarily provide expertise in study design, causal inference, measurement, existing literature, or the feasibility of particular research questions.
A community may identify an important problem while the specific study initially proposed to address it is methodologically weak or asks a question already answered convincingly. Researchers and methodological experts remain necessary for translating priorities into answerable and scientifically defensible questions.
The productive relationship is therefore complementary. Stakeholders can help establish what matters and why. Researchers can help determine what is known, what remains uncertain, and how that uncertainty can be investigated rigorously.
Researchers Also Have Values, Incentives, and Blind Spots
Scientific expertise should not be confused with complete neutrality. Researchers work within disciplines, institutions, funding systems, publication incentives, methodological traditions, and career structures that can influence which problems appear interesting or worthwhile.
A question may be attractive because a dataset is readily available, a method is fashionable, a journal is likely to publish the result, or the topic fits a funding call. Those considerations are not necessarily illegitimate, but they are not equivalent to the importance of the underlying problem.
External perspectives can expose this mismatch. A research community may devote considerable effort to questions that are scientifically tractable while practitioners or affected communities continue to identify different unresolved problems as more consequential.
Funders Have Legitimate Authority but Should Not Be the Only Voice
Funders inevitably influence research priorities because they decide which projects receive resources. Public agencies may be accountable for population needs and public spending. Charities may have missions centered on particular conditions or communities. Private organizations may pursue strategic or commercial objectives.
That authority does not mean funding priorities should be treated as objective measures of research importance. Funding decisions reflect organizational missions, budgets, policy environments, feasibility, portfolio considerations, and value judgments.
A poorly funded problem can still be scientifically or socially important. Conversely, a heavily funded topic is not automatically the most important problem in its field.
Policymakers Know the Decision Context but May Have Different Incentives
Policymakers and institutional leaders can identify evidence needs that researchers might otherwise overlook. They know which decisions are imminent, what constraints apply, and which evidence could realistically influence policy or organizational action.
Yet policy priorities can be short-term, politically constrained, or shaped by electoral and institutional pressures. Research agendas that follow current policy attention exclusively may neglect foundational questions or problems affecting groups with limited political influence.
This is one reason scientific importance should not depend entirely on how much attention a problem currently receives.
Representation Matters Within Stakeholder Groups
"Ask the community" sounds straightforward until researchers ask who speaks for that community. No population is perfectly homogeneous. People affected by the same problem can have different experiences, values, priorities, resources, and preferences.
The most visible, organized, or available participants may not represent people who are hardest to reach. Digital participation can exclude people with limited connectivity. Professional organizations may represent established practitioners more effectively than precarious workers. Patient organizations may not capture every patient's priorities.
Stakeholder engagement therefore requires attention to representation, not merely stakeholder labels.
Power Differences Can Shape the Conversation
Putting researchers, senior policymakers, professionals, and community members in the same room does not automatically create equal participation. Differences in status, technical vocabulary, confidence, institutional authority, and familiarity with research processes can affect whose arguments dominate.
Good priority-setting processes may need facilitation, accessible information, transparent criteria, multiple routes for participation, and procedures that prevent one stakeholder group from controlling the agenda simply because it has greater institutional power.
The Appropriate Balance Depends on What Is Being Decided
Not every research decision requires the same participation structure. A highly technical question about improving an analytical method may reasonably be driven primarily by specialists. A national research agenda allocating public resources across health problems requires a much broader basis of legitimacy. A community-based project should usually give substantial influence to the community whose lives and resources are involved.
The question is therefore not, "Which stakeholder always deserves the greatest say?" It is, "Whose knowledge, interests, and legitimate authority are relevant to this particular priority decision?"
Technical authority
Expertise in determining what is known, what is methodologically credible, and what can realistically be investigated.
Priority-setting legitimacy
A defensible basis for influencing which outcomes, populations, problems, and trade-offs should receive attention.
A person or institution can possess one without possessing the other completely. Good priority setting recognizes both.
Transparent Criteria Matter as Much as Who Is in the Room
Stakeholder participation alone cannot guarantee a defensible priority. Participants also need to know how competing problems will be compared.
Criteria might include severity, prevalence, unmet need, equity, scientific uncertainty, feasibility, expected benefit, cost, or the likelihood that research could produce meaningful change. The appropriate criteria depend on the purpose of the exercise.
WHO's priority-setting guidance emphasizes making criteria and processes explicit. Transparency allows participants and outsiders to understand why one problem received priority over another even when reasonable people might have ranked them differently.