01 · The Question
If Someone Wanted to Stop This Study, What Would Their Best Argument Be?
Researchers become practiced at explaining why their studies should be conducted. A proposal identifies an important problem, reviews relevant literature, establishes a gap, presents research questions, and describes a method capable of answering them. By the time the proposal takes shape, the researcher may have spent months building the case for the project.
There is value in doing the opposite.
Imagine giving your proposal to a knowledgeable but skeptical researcher and asking: “If you had to make the strongest evidence-based case that this study should not be done, what would you say?”
The answer might be uncomfortable. Perhaps the question has already been answered adequately. The theoretical rationale may be weaker than it first appeared. The proposed method may not actually distinguish among competing explanations. The expected contribution may be too small. The study may be feasible only under assumptions that have not been verified.
Finding such an argument before the study begins is useful. Finding it for the first time in a thesis defense, peer-review report, or rejected proposal is considerably less charming.
03 · What You Need to Know
How to Build a Serious Case Against Your Own Research
This exercise resembles a stress test rather than ordinary proposal writing. You temporarily stop acting as the advocate for the project and examine it from the position of someone who must decide whether the study deserves participants, time, money, institutional support, or simply the researcher's next year of work.
That perspective is not foreign to formal research assessment. Major funding systems explicitly evaluate whether proposed work is important, grounded in sufficiently rigorous prior evidence, methodologically appropriate, feasible, and capable of advancing knowledge. The National Institutes of Health, for example, asks reviewers to evaluate whether the scientific background justifies a proposed study and whether the work can be done well within the proposed timeframe. The U.S. National Science Foundation considers whether a project's plan is well reasoned and based on a sound rationale, alongside its potential to advance knowledge. UK Research and Innovation similarly asks whether an approach is appropriate, feasible, and attentive to risks that could affect delivery.
Your internal critic should be asking comparably difficult questions.
Do Not Invent a Weak Objection Just So You Can Defeat It
Suppose your proposed study examines whether a particular educational intervention improves student performance. A weak objection might be: “Some teachers may not like the intervention.” Unless teacher acceptance is central to implementation, this may be easily managed and does little to test the intellectual basis of the study.
A stronger objection might be: “The previous evidence already shows a reasonably consistent effect, and this study uses essentially the same intervention, outcome, population, and design. What consequential uncertainty would another study reduce?”
Or perhaps: “The outcome measure cannot distinguish improvement caused by the intervention from improvement caused by additional instructional time.”
Those objections threaten the justification or interpretability of the project. They deserve an answer.
The purpose is therefore not to compile everything that could go wrong. That broader exercise is useful when considering what could cause an otherwise promising research idea to fail. Here, you are looking for something narrower: the single strongest argument that the study, as currently conceived, should not proceed.
The Strongest Objection May Be That the Question Has Already Been Answered
A research gap does not automatically establish a need for another study. You may identify a population, country, institution, variable combination, or methodological variation that has not appeared in the literature and still have difficulty explaining what important uncertainty the new study would resolve.
The strongest objection might therefore be:
“We already know enough about this question that another study of this kind is unlikely to change what we believe or do.”
This does not mean every study must be unprecedented. Replication, improved estimation, testing generalizability, resolving inconsistent findings, examining mechanisms, and studying theoretically meaningful contexts can all justify additional research. The burden is to explain what the additional evidence contributes.
If this is your strongest objection, examine whether the existing body of evidence may already be sufficient for the claim or decision you want to investigate.
The Rationale May Rest on Evidence That Is Not Strong Enough
A proposal can contain many citations and still have a weak empirical foundation.
Perhaps the studies most central to the rationale used small or selective samples. Findings may be inconsistent. The key construct may have been measured poorly. Observational evidence may have been interpreted causally. A frequently cited claim may ultimately trace back to limited evidence.
NIH guidance explicitly asks applicants and reviewers to consider the strengths and weaknesses of the prior research that provides key support for proposed work. This matters because the logic of a new study may inherit weaknesses from the evidence on which it depends.
A strong objection might therefore be:
“The study assumes that the existing evidence establishes X, but the evidence does not support X strongly enough for the proposed reasoning to follow.”
The appropriate response is not necessarily abandonment. Weak or inconsistent evidence can itself create a reason for better research. But then the study's rationale should acknowledge that uncertainty rather than quietly treating a contested premise as established fact.
The Study May Depend on a Critical Untested Assumption
Research proposals often contain propositions that are neither hypotheses nor explicit methodological decisions but are nevertheless essential to the project.
You may assume that participants can accurately report the behavior of interest. You may assume that a measure functions similarly across groups. You may assume that institutional records represent the construct you want to investigate. You may assume that exposure to an intervention differs sufficiently between conditions to produce a meaningful comparison.
The objection becomes serious when the study collapses if the assumption is false.
Try completing this sentence:
“This study only works if __________ is true.”
Then ask what evidence justifies whatever you placed in the blank. If several answers emerge, explicitly examining the assumptions on which the research idea depends may reveal that one of them is the project's weakest link.
The Proposed Method May Not Actually Answer the Question
Sometimes the strongest argument is methodological rather than conceptual.
A researcher might ask whether an intervention causes an outcome but propose a cross-sectional survey incapable of establishing the required temporal or causal evidence. A study may claim to evaluate learning while measuring only students' perceptions of learning. A researcher may want to understand change but collect data at only one point in time.
The study can be carefully executed and still fail to answer the question it claims to address.
The strongest objection in such cases is not “the method has limitations.” Every method has limitations. It is more fundamental:
“The evidence this design can produce does not warrant the conclusion the research question requires.”
That objection usually calls for revising the design, narrowing the claim, or reconsidering whether a different study could answer the question more appropriately.
A Competing Explanation May Survive the Entire Study
Suppose you expect students who use a particular learning platform to perform better than students who do not. Even if that difference appears, what else could explain it?
Perhaps students choose whether to use the platform, and more motivated students are more likely to adopt it. Perhaps instructors using the platform also provide more support. Perhaps prior achievement differs between groups.
If the design cannot meaningfully address plausible competing explanations, a favorable result may still leave the central question unresolved.
This is particularly important when moving from association to causal interpretation. A statistically convincing relationship does not, by itself, establish that one variable produced the other.
The Study May Be Unable to Produce an Informative Result
Ask what happens under each plausible outcome.
If the expected relationship appears, can you interpret it? If it does not appear, can you interpret that too? If the estimate is uncertain, will the study still tell you something useful?
A proposal becomes vulnerable when only one result is treated as meaningful. If the entire rationale assumes that the anticipated relationship must appear, consider what the study would mean if that expected relationship does not exist.
Null results can be informative when the study is sufficiently rigorous and informative about the magnitude and uncertainty of the effect. By contrast, a poorly measured or inadequately informative study may produce a null result that leaves several explanations unresolved.
The Likely Contribution May Be Too Small for the Required Investment
Research has costs even when no grant is involved. Participants contribute time and sometimes accept inconvenience or risk. Researchers invest months or years. Supervisors, institutions, ethics committees, collaborators, data providers, and eventually peer reviewers may contribute effort.
A study does not need spectacular implications to justify those costs. Much valuable research makes incremental contributions. Yet there should be a defensible relationship between what the study requires and what it could reasonably add.
A strong objection might therefore be:
“Even if this study works exactly as planned, the answer is unlikely to change understanding, reduce meaningful uncertainty, improve a method, test an important boundary, or inform a consequential decision.”
This objection is particularly useful for projects justified primarily by novelty. “Nobody has studied this exact combination before” establishes difference, not necessarily contribution.
The Study May Be Scientifically Interesting but Unrealistic
A project can survive every intellectual criticism and still be a poor study to undertake now.
The required population may be inaccessible. Recruitment estimates may be implausible. The project may depend on data that cannot be obtained. The timeline may be incompatible with longitudinal follow-up. Essential expertise or equipment may be unavailable.
Funding frameworks routinely treat feasibility as part of research quality rather than an afterthought. A methodologically elegant study that cannot be delivered is not strengthened by its elegance.
The strongest objection might therefore be simple: “This is a worthwhile study, but you cannot realistically execute it under the conditions available to you.”
Not Every Strong Objection Is a Fatal Objection
The exercise becomes useful only when you distinguish criticism from disqualification.
| Strong objection |
What it may reveal |
Possible response |
| The question is already sufficiently answered |
Limited incremental contribution |
Identify a consequential unresolved uncertainty or reconsider the study |
| The rationale relies on weak prior evidence |
An unstable foundation for the proposed argument |
Reframe the uncertainty or obtain stronger preliminary support |
| A critical assumption is unverified |
The project depends on something that may not hold |
Verify it, test it preliminarily, or redesign around the uncertainty |
| The design cannot answer the stated question |
Mismatch between question, evidence, and inference |
Change the method or narrow the research question and claims |
| A competing explanation remains plausible |
Limited interpretability |
Improve the design, measurement, comparison, or analytical strategy |
| The likely contribution is very small |
Weak justification for the required investment |
Clarify the contribution, strengthen the study, or redirect the effort |
| The project cannot realistically be executed |
Feasibility failure |
Reduce scope, change the design, obtain resources, or postpone the study |
The important distinction is whether the objection can be answered without changing the study into something fundamentally different. A serious criticism that leads to a stronger design has done useful work. A serious criticism that cannot be answered may be telling you something equally useful.
06 · What This Means for You
Turn the Strongest Objection Into a Decision
Once you have identified the strongest argument against your proposed study, resist the urge to immediately write a rebuttal. First determine what kind of objection it is and what would have to change for it to stop being persuasive.
A simple decision framework
If the objection rests on a misunderstanding of the proposed study
Clarify the rationale, question, constructs, design, or intended claims. If an informed reader could reasonably reach the same misunderstanding, the proposal itself may need revision.
If the objection identifies missing evidence
Find the relevant evidence or obtain preliminary information before treating the underlying premise as established.
If the objection exposes an untested assumption
Determine whether the assumption can be verified, relaxed, measured, or incorporated explicitly into the design.
If the objection concerns the method
Ask whether another defensible design can answer the same question rather than defending the preferred method simply because it was chosen first.
If the objection concerns feasibility
Obtain realistic information about recruitment, access, data, resources, permissions, and timelines before proceeding.
If the objection shows that the study adds too little
Strengthen the contribution, change the question, or redirect the effort toward an uncertainty that still matters.
If the objection remains decisive after reasonable redesign
Consider postponing or abandoning the study rather than weakening the standard by which you judge it.
Ask Someone Else to Make the Case Against You
Self-critique has an obvious limitation: you already know why you like the project.
Ask a supervisor, collaborator, colleague, methodologist, or researcher familiar with the field to argue against the study. Give them permission to challenge the question itself, not merely edit the methodology. A useful prompt is: “Assume you have to recommend that this project not proceed. What is the strongest defensible reason you could give?”
Then listen before defending it.
Different critics may identify different weaknesses. A subject specialist may question the theoretical premise. A methodologist may identify an inference the design cannot support. Someone familiar with the research setting may immediately recognize an access problem invisible in the literature.
Decide What Evidence Would Change Your Mind
A particularly revealing question is not “Can I defend my study?” but “What would convince me not to do it?”
If your answer is “nothing,” you are no longer evaluating the project in a meaningful sense.
Before substantial investment, identify evidence that would change your decision. Perhaps a comprehensive review showing that the question is already sufficiently answered would stop the project. Perhaps preliminary examination showing that the required variable is missing from most records would force redesign. Perhaps discovering that your central measure does not validly represent the construct would change the research question.
Making these conditions explicit also prepares you to decide when abandoning the current research idea is more defensible than continuing to repair it.
Watch Out
The strongest criticism is not necessarily the harshest criticism. Choose the objection with the greatest evidential and logical force, not the one that sounds most devastating. A dramatic complaint based on a weak premise is less useful than a quiet methodological problem that prevents the study from answering its question.