Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

What Is the Strongest Argument Against Doing Your Proposed Study?

Before defending a proposed study, try to construct the strongest credible argument against doing it. A serious objection can expose weaknesses in the rationale, evidence, contribution, design, feasibility, or assumptions while there is still time to respond.

504
The Strongest Argument Against Your Study Guide 504 of 533
01 · The Question

If Someone Wanted to Stop This Study, What Would Their Best Argument Be?

Researchers become practiced at explaining why their studies should be conducted. A proposal identifies an important problem, reviews relevant literature, establishes a gap, presents research questions, and describes a method capable of answering them. By the time the proposal takes shape, the researcher may have spent months building the case for the project.

There is value in doing the opposite.

Imagine giving your proposal to a knowledgeable but skeptical researcher and asking: “If you had to make the strongest evidence-based case that this study should not be done, what would you say?”

The answer might be uncomfortable. Perhaps the question has already been answered adequately. The theoretical rationale may be weaker than it first appeared. The proposed method may not actually distinguish among competing explanations. The expected contribution may be too small. The study may be feasible only under assumptions that have not been verified.

Finding such an argument before the study begins is useful. Finding it for the first time in a thesis defense, peer-review report, or rejected proposal is considerably less charming.

02 · The Short Answer

Make the Best Case Against Your Study Before Making the Case for It

In Brief

The strongest argument against doing your proposed study is the most credible objection that, if true, would substantially weaken its justification, feasibility, interpretability, or likely contribution.

Do not look for an objection that is easy to dismiss. Construct the strongest version you can support with evidence, then determine whether your study already answers it, can be redesigned to address it, or should not proceed in its current form.

03 · What You Need to Know

How to Build a Serious Case Against Your Own Research

This exercise resembles a stress test rather than ordinary proposal writing. You temporarily stop acting as the advocate for the project and examine it from the position of someone who must decide whether the study deserves participants, time, money, institutional support, or simply the researcher's next year of work.

That perspective is not foreign to formal research assessment. Major funding systems explicitly evaluate whether proposed work is important, grounded in sufficiently rigorous prior evidence, methodologically appropriate, feasible, and capable of advancing knowledge. The National Institutes of Health, for example, asks reviewers to evaluate whether the scientific background justifies a proposed study and whether the work can be done well within the proposed timeframe. The U.S. National Science Foundation considers whether a project's plan is well reasoned and based on a sound rationale, alongside its potential to advance knowledge. UK Research and Innovation similarly asks whether an approach is appropriate, feasible, and attentive to risks that could affect delivery.

Your internal critic should be asking comparably difficult questions.

Do Not Invent a Weak Objection Just So You Can Defeat It

Suppose your proposed study examines whether a particular educational intervention improves student performance. A weak objection might be: “Some teachers may not like the intervention.” Unless teacher acceptance is central to implementation, this may be easily managed and does little to test the intellectual basis of the study.

A stronger objection might be: “The previous evidence already shows a reasonably consistent effect, and this study uses essentially the same intervention, outcome, population, and design. What consequential uncertainty would another study reduce?”

Or perhaps: “The outcome measure cannot distinguish improvement caused by the intervention from improvement caused by additional instructional time.”

Those objections threaten the justification or interpretability of the project. They deserve an answer.

The purpose is therefore not to compile everything that could go wrong. That broader exercise is useful when considering what could cause an otherwise promising research idea to fail. Here, you are looking for something narrower: the single strongest argument that the study, as currently conceived, should not proceed.

The Strongest Objection May Be That the Question Has Already Been Answered

A research gap does not automatically establish a need for another study. You may identify a population, country, institution, variable combination, or methodological variation that has not appeared in the literature and still have difficulty explaining what important uncertainty the new study would resolve.

The strongest objection might therefore be:

“We already know enough about this question that another study of this kind is unlikely to change what we believe or do.”

This does not mean every study must be unprecedented. Replication, improved estimation, testing generalizability, resolving inconsistent findings, examining mechanisms, and studying theoretically meaningful contexts can all justify additional research. The burden is to explain what the additional evidence contributes.

If this is your strongest objection, examine whether the existing body of evidence may already be sufficient for the claim or decision you want to investigate.

The Rationale May Rest on Evidence That Is Not Strong Enough

A proposal can contain many citations and still have a weak empirical foundation.

Perhaps the studies most central to the rationale used small or selective samples. Findings may be inconsistent. The key construct may have been measured poorly. Observational evidence may have been interpreted causally. A frequently cited claim may ultimately trace back to limited evidence.

NIH guidance explicitly asks applicants and reviewers to consider the strengths and weaknesses of the prior research that provides key support for proposed work. This matters because the logic of a new study may inherit weaknesses from the evidence on which it depends.

A strong objection might therefore be:

“The study assumes that the existing evidence establishes X, but the evidence does not support X strongly enough for the proposed reasoning to follow.”

The appropriate response is not necessarily abandonment. Weak or inconsistent evidence can itself create a reason for better research. But then the study's rationale should acknowledge that uncertainty rather than quietly treating a contested premise as established fact.

The Study May Depend on a Critical Untested Assumption

Research proposals often contain propositions that are neither hypotheses nor explicit methodological decisions but are nevertheless essential to the project.

You may assume that participants can accurately report the behavior of interest. You may assume that a measure functions similarly across groups. You may assume that institutional records represent the construct you want to investigate. You may assume that exposure to an intervention differs sufficiently between conditions to produce a meaningful comparison.

The objection becomes serious when the study collapses if the assumption is false.

Try completing this sentence:

“This study only works if __________ is true.”

Then ask what evidence justifies whatever you placed in the blank. If several answers emerge, explicitly examining the assumptions on which the research idea depends may reveal that one of them is the project's weakest link.

The Proposed Method May Not Actually Answer the Question

Sometimes the strongest argument is methodological rather than conceptual.

A researcher might ask whether an intervention causes an outcome but propose a cross-sectional survey incapable of establishing the required temporal or causal evidence. A study may claim to evaluate learning while measuring only students' perceptions of learning. A researcher may want to understand change but collect data at only one point in time.

The study can be carefully executed and still fail to answer the question it claims to address.

The strongest objection in such cases is not “the method has limitations.” Every method has limitations. It is more fundamental:

“The evidence this design can produce does not warrant the conclusion the research question requires.”

That objection usually calls for revising the design, narrowing the claim, or reconsidering whether a different study could answer the question more appropriately.

A Competing Explanation May Survive the Entire Study

Suppose you expect students who use a particular learning platform to perform better than students who do not. Even if that difference appears, what else could explain it?

Perhaps students choose whether to use the platform, and more motivated students are more likely to adopt it. Perhaps instructors using the platform also provide more support. Perhaps prior achievement differs between groups.

If the design cannot meaningfully address plausible competing explanations, a favorable result may still leave the central question unresolved.

This is particularly important when moving from association to causal interpretation. A statistically convincing relationship does not, by itself, establish that one variable produced the other.

The Study May Be Unable to Produce an Informative Result

Ask what happens under each plausible outcome.

If the expected relationship appears, can you interpret it? If it does not appear, can you interpret that too? If the estimate is uncertain, will the study still tell you something useful?

A proposal becomes vulnerable when only one result is treated as meaningful. If the entire rationale assumes that the anticipated relationship must appear, consider what the study would mean if that expected relationship does not exist.

Null results can be informative when the study is sufficiently rigorous and informative about the magnitude and uncertainty of the effect. By contrast, a poorly measured or inadequately informative study may produce a null result that leaves several explanations unresolved.

The Likely Contribution May Be Too Small for the Required Investment

Research has costs even when no grant is involved. Participants contribute time and sometimes accept inconvenience or risk. Researchers invest months or years. Supervisors, institutions, ethics committees, collaborators, data providers, and eventually peer reviewers may contribute effort.

A study does not need spectacular implications to justify those costs. Much valuable research makes incremental contributions. Yet there should be a defensible relationship between what the study requires and what it could reasonably add.

A strong objection might therefore be:

“Even if this study works exactly as planned, the answer is unlikely to change understanding, reduce meaningful uncertainty, improve a method, test an important boundary, or inform a consequential decision.”

This objection is particularly useful for projects justified primarily by novelty. “Nobody has studied this exact combination before” establishes difference, not necessarily contribution.

The Study May Be Scientifically Interesting but Unrealistic

A project can survive every intellectual criticism and still be a poor study to undertake now.

The required population may be inaccessible. Recruitment estimates may be implausible. The project may depend on data that cannot be obtained. The timeline may be incompatible with longitudinal follow-up. Essential expertise or equipment may be unavailable.

Funding frameworks routinely treat feasibility as part of research quality rather than an afterthought. A methodologically elegant study that cannot be delivered is not strengthened by its elegance.

The strongest objection might therefore be simple: “This is a worthwhile study, but you cannot realistically execute it under the conditions available to you.”

Not Every Strong Objection Is a Fatal Objection

The exercise becomes useful only when you distinguish criticism from disqualification.

Strong objection What it may reveal Possible response
The question is already sufficiently answered Limited incremental contribution Identify a consequential unresolved uncertainty or reconsider the study
The rationale relies on weak prior evidence An unstable foundation for the proposed argument Reframe the uncertainty or obtain stronger preliminary support
A critical assumption is unverified The project depends on something that may not hold Verify it, test it preliminarily, or redesign around the uncertainty
The design cannot answer the stated question Mismatch between question, evidence, and inference Change the method or narrow the research question and claims
A competing explanation remains plausible Limited interpretability Improve the design, measurement, comparison, or analytical strategy
The likely contribution is very small Weak justification for the required investment Clarify the contribution, strengthen the study, or redirect the effort
The project cannot realistically be executed Feasibility failure Reduce scope, change the design, obtain resources, or postpone the study

The important distinction is whether the objection can be answered without changing the study into something fundamentally different. A serious criticism that leads to a stronger design has done useful work. A serious criticism that cannot be answered may be telling you something equally useful.

04 · A Practical Example

Arguing Against a Study You Already Want to Conduct

Hypothetical Example

Does Generative AI Improve University Students' Academic Writing?

Suppose a researcher proposes comparing students who use generative AI while writing an academic essay with students who complete the same task without it. The researcher argues that the study is timely because generative AI is increasingly used in higher education and educators need evidence about its effects on student writing.

Initial defense The topic is current, the educational implications appear important, and the study could produce an easily understood comparison between two groups.
Weak counterargument “Generative AI is changing quickly, so the study might become outdated.” This is relevant, but it does not necessarily undermine the central research question.
Stronger counterargument “Students do not simply use or not use generative AI. They use different tools, prompts, amounts of generated text, revision strategies, and verification practices. Treating AI use as one uniform intervention may collapse substantively different behaviors into the same condition.”
Even stronger counterargument “If the study finds better essays in the AI condition, the design may show that access to AI changes the quality of the submitted product, but it may not establish that students' academic writing ability improved. The outcome being measured and the claim being made are not necessarily the same.”
Response The researcher revises the question. Rather than claiming to measure improvement in writing ability, the study distinguishes quality of written output from learning, defines the permitted forms of AI assistance, documents actual patterns of use, and selects outcomes appropriate to the claims being made.
Result The strongest objection does not destroy the research idea. It exposes an ambiguity in the construct and inference, leading to a more defensible study.

This is what a productive counterargument should accomplish. Its purpose is not to make the researcher surrender. It should identify the point at which the logic of the proposal is most vulnerable and force a decision about whether that vulnerability can be repaired.

05 · What Researchers Often Get Wrong

Common Mistakes When Critiquing Your Own Proposed Study

Misconception

The Goal Is to Prove That the Study Is a Good Idea

Not during this exercise. If you begin with the requirement that the project must survive, you are likely to choose objections you already know how to answer. Temporarily allow the possibility that abandoning or fundamentally redesigning the study could be the correct conclusion.

Misconception

Listing the Study's Limitations Is the Same as Arguing Against It

No. A limitation may constrain interpretation without undermining the reason for conducting the research. The strongest argument against the study asks whether a weakness is consequential enough to challenge its justification, design, feasibility, interpretability, or contribution.

Misconception

If You Can Respond to an Objection, You Have Refuted It

A response is not necessarily an adequate answer. “We acknowledge this limitation” may be appropriate in some circumstances, but acknowledgment does not repair a design that cannot support its intended inference. Ask whether the objection has actually been resolved or merely described.

Misconception

No Previous Study in My Exact Setting Means the Study Is Justified

Geographical, institutional, or population novelty can matter when there is a credible reason the phenomenon may differ in that context. Absence of an identical previous study is not, by itself, evidence that the missing study is consequential. Explain what uncertainty the new context allows you to investigate.

Misconception

A Null Result Would Prove the Study Was Not Worth Doing

Whether a study is worthwhile should not depend entirely on obtaining the result the researcher hopes to find. A rigorous study may provide useful evidence when an expected effect is absent. The more revealing question is whether the study remains worth doing if its main result is null.

Misconception

Finding a Strong Argument Against the Study Means the Idea Is Bad

Many worthwhile studies face serious objections. The critical issue is what happens after the objection is identified. Some objections can be addressed by stronger measurement, better controls, narrower claims, additional preliminary evidence, or a different design. Others reveal that the current project should not proceed.

06 · What This Means for You

Turn the Strongest Objection Into a Decision

Once you have identified the strongest argument against your proposed study, resist the urge to immediately write a rebuttal. First determine what kind of objection it is and what would have to change for it to stop being persuasive.

A simple decision framework

If the objection rests on a misunderstanding of the proposed study
Clarify the rationale, question, constructs, design, or intended claims. If an informed reader could reasonably reach the same misunderstanding, the proposal itself may need revision.
If the objection identifies missing evidence
Find the relevant evidence or obtain preliminary information before treating the underlying premise as established.
If the objection exposes an untested assumption
Determine whether the assumption can be verified, relaxed, measured, or incorporated explicitly into the design.
If the objection concerns the method
Ask whether another defensible design can answer the same question rather than defending the preferred method simply because it was chosen first.
If the objection concerns feasibility
Obtain realistic information about recruitment, access, data, resources, permissions, and timelines before proceeding.
If the objection shows that the study adds too little
Strengthen the contribution, change the question, or redirect the effort toward an uncertainty that still matters.
If the objection remains decisive after reasonable redesign
Consider postponing or abandoning the study rather than weakening the standard by which you judge it.

Ask Someone Else to Make the Case Against You

Self-critique has an obvious limitation: you already know why you like the project.

Ask a supervisor, collaborator, colleague, methodologist, or researcher familiar with the field to argue against the study. Give them permission to challenge the question itself, not merely edit the methodology. A useful prompt is: “Assume you have to recommend that this project not proceed. What is the strongest defensible reason you could give?”

Then listen before defending it.

Different critics may identify different weaknesses. A subject specialist may question the theoretical premise. A methodologist may identify an inference the design cannot support. Someone familiar with the research setting may immediately recognize an access problem invisible in the literature.

Decide What Evidence Would Change Your Mind

A particularly revealing question is not “Can I defend my study?” but “What would convince me not to do it?”

If your answer is “nothing,” you are no longer evaluating the project in a meaningful sense.

Before substantial investment, identify evidence that would change your decision. Perhaps a comprehensive review showing that the question is already sufficiently answered would stop the project. Perhaps preliminary examination showing that the required variable is missing from most records would force redesign. Perhaps discovering that your central measure does not validly represent the construct would change the research question.

Making these conditions explicit also prepares you to decide when abandoning the current research idea is more defensible than continuing to repair it.

Watch Out

The strongest criticism is not necessarily the harshest criticism. Choose the objection with the greatest evidential and logical force, not the one that sounds most devastating. A dramatic complaint based on a weak premise is less useful than a quiet methodological problem that prevents the study from answering its question.

07 · A Quick Checklist

Challenge Your Proposed Study Before Someone Else Does

Before committing to the study, check:
State in one sentence the strongest evidence-based argument for not conducting the proposed study.
Check whether the prior evidence supporting your rationale is sufficiently rigorous and directly relevant to the premises you rely on.
Ask whether existing research has already reduced the important uncertainty enough that another similar study would add little.
Identify any assumption whose failure would substantially weaken or invalidate the study.
Verify that the proposed design can produce evidence appropriate to the research question and the conclusions you intend to draw.
Identify plausible competing explanations that could survive even if the expected result appears.
Determine whether expected, null, and unexpected findings would each remain interpretable.
Compare the likely contribution with the time, participant burden, resources, and other costs required to produce it.
Ask an informed researcher who is not invested in the project to make the strongest case against it.
Specify what evidence would make you redesign, postpone, or abandon the study.
08 · Frequently Asked Questions

Questions About Challenging Your Own Research Proposal

Why should I argue against my own research proposal?

Because developing a proposal naturally encourages you to accumulate reasons in its favor. Deliberately constructing the opposing case can expose weaknesses in the rationale, evidence, assumptions, design, feasibility, or contribution before those weaknesses become expensive to address.

What makes an objection to a research study strong?

A strong objection is plausible, supported by evidence or sound methodological reasoning, and consequential. If it is correct, something important about the study changes: its justification weakens, its design cannot answer the question, its findings become difficult to interpret, its execution becomes unrealistic, or its likely contribution becomes insufficient.

Should I include arguments against my study in the research proposal?

Usually you should address consequential weaknesses rather than reproduce an adversarial exercise verbatim. How this is presented depends on the proposal format. Relevant limitations, weaknesses in prior evidence, methodological risks, alternative explanations, and mitigation strategies should be discussed where they affect the rationale or approach rather than hidden from reviewers.

What if I find several equally serious arguments against the study?

Address all consequential objections, but try to determine whether they share a deeper cause. Several apparent problems may stem from one underlying issue, such as an unclear construct, an inappropriate design, inaccessible data, or an unsupported assumption. Fixing the underlying problem may resolve several objections at once.

What if I cannot answer the strongest objection?

Do not assume that you need a cleverer rebuttal. Determine whether the study can be redesigned so that the objection no longer applies. If the criticism remains decisive after reasonable changes, postponing, reframing, or abandoning the project may be more defensible than proceeding with a study you already know cannot withstand its strongest criticism.

Does every study need to be highly novel to survive this test?

No. Novelty and value are not identical. Replications, confirmatory studies, improved estimates, methodological comparisons, and investigations of theoretically meaningful contexts may make important contributions without asking entirely unprecedented questions. The study should have a credible reason why its additional evidence matters.

Could the strongest argument simply be that the project is too difficult?

Yes, if the difficulty translates into genuine infeasibility. A challenging study is not automatically a bad study, but a project that cannot realistically recruit its sample, obtain its data, implement its method, secure necessary approvals, or finish within available resources has a substantive problem rather than merely an inconvenient one.

09 · The Bottom Line

Your Study Should Survive More Than Its Own Sales Pitch

The Bottom Line

Before committing to a proposed study, identify the strongest credible argument against doing it and determine whether that objection can genuinely be answered rather than merely acknowledged.

If the criticism exposes a repairable weakness, use it to improve the study. If it reveals that the question is already sufficiently answered, the design cannot support the intended inference, a critical assumption is indefensible, or the project cannot realistically deliver meaningful evidence, changing course may be the more rigorous research decision.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes