Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

What Should Researchers Do When Stakeholders Disagree About How the Study Should Be Designed?

Stakeholder disagreement is not necessarily a failure of engagement. Researchers should make differences explicit, identify what is driving them, use agreed decision processes, preserve methodological and ethical requirements, and document how consequential decisions are reached.

61
Stakeholder Disagreement in Research Design Guide 61 of 217
01 · The Question

What Happens When Research Partners Want Different Studies?

A patient group wants an outcome that reflects everyday functioning. Clinicians prefer a clinical measure they already use. Community partners want recruitment to occur through trusted local organizations, while researchers worry that the approach could affect sampling. A funder expects the project to remain close to the proposal that received funding.

Everyone is a legitimate stakeholder. Everyone has reasons for their position. They do not agree.

This situation is not unusual, nor does it necessarily mean stakeholder engagement has failed. Meaningful involvement can actually make disagreement more visible because people who would previously have had little influence now have opportunities to challenge assumptions and propose alternatives.

The goal should not be to eliminate disagreement. It should be to make decisions through a process that is transparent, methodologically and ethically defensible, proportionate to the partnership, and respectful of the people whose views ultimately do not prevail.

02 · The Short Answer

Treat Disagreement as a Decision Problem, Not a Failure of Partnership

In Brief

When stakeholders disagree about research design, researchers should identify the underlying reasons for the disagreement, clarify who has authority over the decision, examine relevant evidence and constraints, use an agreed process to seek a workable resolution, and document important decisions and unresolved differences.

Consensus can be desirable but should not be forced. Some disagreements reflect different expertise, values, experiences, risks, or interests rather than misunderstandings. When conflict becomes unproductive, neutral facilitation or mediation may help, while methodological, ethical, legal, and regulatory requirements still place legitimate boundaries on what the project can decide.

03 · What You Need to Know

Productive Research Partnerships Need Ways to Disagree

Disagreement is often evidence that different perspectives are actually present

A stakeholder group in which everyone always agrees may be wonderfully harmonious. It may also be unusually homogeneous, reluctant to challenge authority, or involved only in decisions too inconsequential to provoke disagreement.

Different stakeholders bring different knowledge and priorities. Patients may value outcomes differently from clinicians. Practitioners may prioritize feasibility. Researchers may focus on validity. Community organizations may emphasize trust and accessibility. Funders and institutions may introduce additional constraints.

PCORI's current guidance on meaningful inclusion of partners in decision-making explicitly recognizes different viewpoints as potentially valuable because they can challenge assumptions and reveal new approaches that improve the acceptability and relevance of study activities.

The objective is therefore not agreement for its own sake. It is productive use of disagreement.

Start by identifying what people actually disagree about

Two people may appear to disagree about a method when their real disagreement concerns something else.

Consider a dispute over whether interviews should occur online. One partner may be concerned about accessibility. Another may be concerned about participant privacy. The research team may be concerned about cost and geographic reach.

These are not necessarily competing preferences about technology. They are competing judgments about which risks and benefits matter most.

Before trying to resolve the dispute, ask each side to explain the reasoning behind its position.

Possible source of disagreement Example Useful question
Different evidence Partners rely on different information about what will work What evidence is each position based on?
Different expertise A statistician and community partner assess a sampling strategy differently Which aspect of the decision does each person understand particularly well?
Different values Partners disagree about burden versus completeness of measurement What trade-off is each person prioritizing?
Different affected interests Participants bear a burden that researchers do not Who experiences the consequences of this decision?
Different incentives An organization wants favorable findings while researchers prioritize independent reporting Are there interests that should be made explicit?
Different understanding Partners interpret a technical requirement differently Would clearer information resolve the disagreement?

Diagnosing the source of disagreement can reveal solutions that a simple vote would miss.

Do not assume that the researchers' position is automatically the neutral one

Researchers often occupy the formal authority position in a project. That does not make their preferences neutral.

A researcher may prefer an established measure because it facilitates publication or comparison with previous studies. A community partner may prefer a different outcome because it reflects what people actually experience. Both positions contain legitimate considerations.

The team should examine the reasoning behind each rather than framing one as “scientific” and the other as merely “stakeholder preference.”

At the same time, not every disagreement is symmetrical. Some methodological requirements are necessary for the study to answer its question, and some ethical or legal obligations cannot be negotiated away.

Clarify who has authority over the decision

Disagreement becomes particularly difficult when nobody knows who is supposed to decide.

PCORI recommends establishing engagement structures and decision-making processes that clarify authority, communication, and information flow. Its guidance describes partner decision-making authority as existing along a continuum from providing input to shared leadership.

This means teams should decide in advance how different categories of decisions will be handled.

Some may be delegated to working groups. Some may require consensus. Others may use majority decisions. Particular technical or regulatory matters may carry specified professional responsibility. More collaborative projects may share authority more extensively.

The appropriate arrangement follows from how much influence research partners have been given over study decisions.

Explain genuine constraints rather than invoking them vaguely

“We can't do that” is rarely enough.

If a stakeholder proposal conflicts with the approved protocol, researchers can explain what amendment would be required. If an outcome cannot be measured reliably, explain the measurement problem. If a recruitment proposal creates a sampling concern, explain how it could affect inference.

Specific explanations allow partners to propose alternatives.

A desired outcome may not be measurable with the proposed instrument but could be investigated another way. A recruitment strategy may create bias but could supplement rather than replace another strategy. An ethics concern may be addressed by changing the procedure rather than abandoning the underlying idea.

Constraints should structure collaborative problem solving rather than end the conversation automatically.

Look for the underlying objective before choosing between proposals

Many apparent either-or disputes can be reframed.

Suppose community partners want shorter questionnaires because participants are overburdened, while researchers want longer questionnaires because several constructs must be measured.

The real objectives are not “short questionnaire” versus “long questionnaire.” They are reducing burden and collecting sufficient information.

Once those objectives are explicit, alternatives become possible: remove redundant measures, reduce measurement frequency, use administrative data for some variables, prioritize essential outcomes, or pilot the burden before finalizing procedures.

Good conflict resolution often begins by asking what each proposed solution is trying to protect.

Use evidence when the disagreement is empirically resolvable

Some disagreements concern questions that evidence can help answer.

Researchers and partners may disagree about whether recruitment language is understandable, whether a questionnaire is too burdensome, or whether a proposed intervention can be delivered in practice. Pilot testing, cognitive interviews, feasibility data, existing literature, or other evidence may help resolve the dispute.

Not every disagreement can be settled empirically. Questions about acceptable burden, fairness, priorities, or which outcomes matter can contain value judgments that data alone do not determine.

The team should distinguish disagreements that need more evidence from disagreements that require a legitimate choice among competing values.

Consensus should not be manufactured

Consensus can be valuable when people reach it through genuine deliberation. It becomes problematic when agreement is produced through pressure, exhaustion, status, or fear of damaging relationships.

PCORI describes productive disagreement as the ability to express different viewpoints and openly disagree while maintaining mutual respect.

A partner who disagrees should not automatically be treated as obstructive. Nor should a researcher be expected to abandon a legitimate methodological concern simply to demonstrate collaboration.

When reasonable disagreement remains, the project can use its agreed decision process and record the reasoning behind the outcome.

Minority views can be preserved

A final decision does not require pretending that everyone supported it.

Teams can record significant dissent in meeting records, internal decision logs, engagement reports, or, where relevant, publications. This can be particularly important when a minority perspective reveals an ethical concern, a limitation, or an experience that would otherwise disappear behind a statement such as “stakeholders agreed.”

Preserving dissent is not necessary for every minor disagreement. It is useful when the difference is consequential to understanding how the study was designed or what limitations remain.

Power affects whose disagreement gets heard

Not every person enters a disagreement with equal institutional power.

Principal investigators may control grants and employment. Clinicians may carry professional authority. Community partners may depend on the organization being studied. Junior staff may hesitate to contradict senior investigators. Patients may be the only non-professional members in a room full of academics.

PCORI's current guidance explicitly asks teams to recognize power imbalances and notes that status, background, institutional practices, and access to decision-making roles can affect partners' ability to participate fully.

Facilitators should therefore pay attention not only to what is said but to who has realistic opportunities to say it.

Team norms can make disagreement safer

PCORI recommends establishing and revisiting team norms so disagreement can be handled productively and respectfully.

Useful norms might address how people challenge ideas, how interruptions are handled, whether everyone has an opportunity to speak, how decisions are recorded, what happens when someone experiences disrespect, and how unresolved issues are escalated.

These arrangements can seem unnecessarily formal while everyone gets along. Their value becomes clearer during the first difficult disagreement, which is approximately when discovering that nobody agreed on the rules becomes least convenient.

Unproductive conflict may require neutral facilitation or mediation

Not every conflict can be solved inside an ordinary project meeting.

PCORI recommends acknowledging disagreement, seeking to understand differences, maintaining mutual respect, and addressing disrespectful behavior. When conflict cannot be resolved, it suggests considering an expert in mediation or conflict negotiation who can act as a neutral third party.

This can be especially useful when interpersonal history, organizational interests, or damaged trust prevent the group from discussing the substantive decision productively.

Bringing in mediation is not necessarily evidence that the partnership has failed. Sometimes it is evidence that the partnership takes conflict seriously enough not to let institutional power settle it by default.

Some decisions still have non-negotiable boundaries

Participatory decision-making does not permit a project to ignore research ethics, participant safety, legal requirements, contractual obligations, or basic methodological integrity.

If partners request a procedure that would expose participants to unacceptable risk, violate privacy requirements, or make the study incapable of answering its research question, the project cannot implement it merely to preserve consensus.

Researchers should explain why the boundary exists and explore alternatives where possible.

The same principle applies when stakeholder priorities improve relevance without being allowed to predetermine evidence.

Repair the relationship when conflict causes harm

Sometimes the decision itself is resolved but the relationship is not.

A dismissive comment, repeated interruption, misuse of authority, or failure to honor an agreed process can damage trust even if the project eventually reaches a workable methodological solution.

PCORI's guidance explicitly addresses repairing trust after conflict. This includes recognizing how behavior affected team members and agreeing on changes needed to restore a productive working relationship.

Partnership governance should therefore consider both the substantive research decision and the quality of the relationship through which it was made.

04 · A Practical Example

Working Through a Disagreement About Recruitment

Hypothetical Example

Community partners and researchers disagree about where recruitment should occur

A research team studying access to preventive healthcare plans to recruit through clinics. Community partners argue that this will systematically miss people who rarely use healthcare services and recommend recruiting through local organizations instead.

Make the disagreement explicit Researchers explain that clinic recruitment offers a clearly defined sampling frame. Community partners explain that the approach may exclude precisely the people whose access barriers are most consequential.
Identify the underlying objectives Both groups want a sample relevant to the research question. Researchers are protecting sampling defensibility; community partners are protecting inclusion of people disconnected from clinical services.
Examine alternatives The team considers whether clinic and community recruitment can be combined, how each source would be documented, and what implications the resulting sampling strategy would have for analysis and interpretation.
Use the agreed decision process The project team selects a combined approach after methodological review and records why the original strategy changed.
Document remaining limitations The team acknowledges that the revised strategy improves reach but does not create a probability sample of the entire community. The limitation is reported rather than hidden behind the language of partnership.

The disagreement improved the study because neither side treated its initial preference as automatically decisive. Community knowledge exposed a sampling problem, while methodological analysis clarified what the proposed solution could and could not support.

05 · What Researchers Often Get Wrong

Common Mistakes When Stakeholders Disagree

Misconception

Does good stakeholder engagement require consensus?

No. Consensus can be useful but is not proof of meaningful engagement. Different stakeholders can reasonably hold different priorities and interpretations. A legitimate process for disagreement is more important than forcing unanimity.

Misconception

Should researchers have the final say because they are methodologists?

Not automatically. Methodological expertise gives researchers particular responsibilities, but many design decisions also involve feasibility, lived experience, acceptability, burden, or community knowledge. Decision authority should reflect the nature of the issue and the governance agreed for the partnership.

Misconception

Should stakeholders win whenever the study claims to be participatory?

No. Participatory research provides meaningful influence, not automatic victory in every disagreement. Ethical requirements, methodological integrity, evidence, affected interests, and agreed decision structures still matter.

Misconception

Is voting the easiest fair solution?

Voting can be appropriate for some decisions, but it can also conceal differences in expertise, affected interests, representation, and power. Before voting, determine whether the decision is actually suitable for majority rule and whether everyone has sufficient information to participate meaningfully.

Misconception

Should difficult partners simply be replaced?

Not because they disagree. Persistent challenge may reflect legitimate concerns that the project needs to hear. Disrespectful or harmful behavior should be addressed through agreed norms, but labeling dissent as difficulty can turn stakeholder engagement into a search for people who reliably agree with researchers.

Misconception

If the team reaches a decision, should the disagreement disappear from the record?

Not necessarily. Consequential dissent may be worth documenting, particularly when it explains a design choice or an unresolved limitation. A final decision and continuing disagreement can coexist.

06 · What This Means for You

Design a Conflict Process Before You Need One

Do not wait for a serious dispute to determine how the partnership makes decisions. Establish the process while people are still discussing hypothetical disagreements rather than defending actual positions.

A simple decision framework

If disagreement appears to arise from different information or assumptions
Clarify the evidence and reasoning behind each position before trying to choose between them.
If different forms of expertise are relevant
Identify which aspect of the decision each form of knowledge can inform and look for a solution that addresses both where possible.
If the disagreement concerns competing values or priorities
Make the trade-off explicit and use the agreed governance process rather than pretending that technical evidence alone determines the choice.
If a proposal conflicts with a genuine ethical, legal, regulatory, or methodological boundary
Explain the constraint specifically and explore alternatives that preserve the underlying stakeholder concern where possible.
If conflict becomes personal, disrespectful, or impossible to resolve internally
Use established team norms and consider neutral facilitation, mediation, or conflict-resolution expertise.

Document consequential decisions. A brief decision log can record the issue, perspectives considered, relevant evidence or constraints, who had decision authority, the final decision, and any important dissent.

Watch Out

Do not treat the absence of objections as agreement when power differences make speaking difficult. Actively create opportunities for less institutionally powerful partners to express concerns, including outside large meetings when appropriate.

Finally, distinguish a methodological disagreement from a damaged relationship. You may resolve the sampling plan and still need to address the fact that someone was dismissed, interrupted, or excluded from the decision. Both problems deserve attention.

07 · A Quick Checklist

When Research Partners Disagree About Study Design

Before making the final decision, check:
Has each position been stated clearly enough that everyone understands the actual disagreement?
Have you identified whether the difference concerns evidence, expertise, values, affected interests, incentives, or misunderstanding?
Is it clear who has authority to make this category of decision?
Have methodological, ethical, legal, regulatory, funding, and practical constraints been explained specifically rather than invoked vaguely?
Could additional evidence, pilot testing, or another design option address the underlying concerns?
Have power differences affected who is able to speak, disagree, or influence the discussion?
Are team norms for respectful disagreement being followed?
Should consequential minority or dissenting views be documented?
If the conflict has damaged trust, has the relationship itself been addressed rather than only the research decision?
08 · Frequently Asked Questions

Frequently Asked Questions About Stakeholder Disagreement

Is disagreement a sign that stakeholder engagement is failing?

No. Different viewpoints can challenge assumptions and improve research decisions. PCORI explicitly recognizes productive disagreement as part of meaningful partnership. The concern is not disagreement itself but whether it becomes disrespectful, exclusionary, or impossible to resolve through legitimate processes.

Who should have the final say when stakeholders disagree?

There is no universal answer. Authority should depend on the type of decision, relevant expertise, affected interests, formal responsibilities, and governance agreed for the partnership. Teams should establish these processes before major disagreements arise.

What if patients and clinicians want different outcomes?

First determine why the outcomes differ and whether the study can include more than one meaningful outcome. Consider patient relevance, clinical importance, measurement validity, feasibility, and the research question. If a choice remains necessary, use the project's agreed decision process and document the reasoning.

Can stakeholders overrule a methodological decision?

That depends on the project's governance and the decision. Stakeholders can have substantial authority in participatory research, but decisions must still satisfy necessary methodological, ethical, legal, and regulatory requirements. Specialized expertise may be essential for particular technical judgments.

Should the team vote when it cannot reach consensus?

Voting is one possible mechanism but is not appropriate automatically. Consider whether majority rule fits the decision, whether all voters have sufficient information, and whether differences in expertise, affected interests, or formal responsibilities require another process.

When should a research team use a mediator?

Neutral mediation or conflict-negotiation expertise may be useful when disagreement has become unproductive, relationships or trust have been damaged, or the team cannot resolve the issue through its normal processes. PCORI explicitly identifies third-party mediation as an option when conflict cannot be resolved internally.

Should stakeholder disagreements be reported in publications?

Not every disagreement needs to appear in a paper. However, consequential disagreement may warrant reporting when it materially influenced the design, interpretation, engagement process, or limitations. At minimum, important decisions should be documented within the project.

What if one stakeholder repeatedly blocks decisions?

Examine why. The person may be identifying a recurring legitimate concern, may misunderstand their role, or may be engaging in behavior that prevents productive work. Apply agreed decision and conduct norms consistently. Persistent disagreement and disrespectful behavior are different problems and should not be conflated.

09 · The Bottom Line

Good Stakeholder Engagement Makes Room for Disagreement

The Bottom Line

When stakeholders disagree about research design, the goal is not to force consensus but to understand the competing perspectives, clarify decision authority, examine evidence and constraints, and reach decisions through a transparent process that respects both partnership and research integrity.

Plan how disagreements will be handled before they occur, make power differences visible, document consequential reasoning and dissent, and use neutral facilitation or mediation when conflict becomes unproductive. A partnership capable of disagreeing constructively may be stronger than one in which everyone appears to agree because some people never felt able to object.

10 · Sources and Further Reading

Authoritative Resources on Stakeholder Decision-Making and Conflict

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes