03 · What You Need to Know
Specificity Is Valuable Until It Removes the Reason for Doing the Research
A feasible question still needs to be worth answering
Research-question frameworks make an important distinction between whether a study can be conducted and whether its question is worth investigating. The widely used FINER criteria ask whether a research question is Feasible, Interesting, Novel, Ethical, and Relevant. Feasibility includes considerations such as time, resources, expertise, participant or data availability, and manageable scope. Novelty and relevance ask different questions: what the research adds and why the answer matters.
This distinction is crucial when narrowing scope. A researcher can improve feasibility by repeatedly restricting a project, but those restrictions do not automatically preserve interest, novelty, or relevance.
Imagine beginning with a difficult question about how generative AI affects university students' academic writing. You progressively restrict the study to one institution, one program, one class, one assignment, one AI tool, one week, and one easily measured outcome.
That final study might be methodologically defensible. It might also be so narrowly framed that you need to ask what uncertainty its answer actually resolves.
The appropriate question is therefore not simply, "Can I complete this?" It is also: "If I complete it successfully, what will we know that is worth knowing?"
Too narrow is not the same as small
A small study can address a large intellectual problem.
A single case can challenge an assumed mechanism, illuminate an unusual implementation, provide detailed evidence about an understudied phenomenon, generate theory, reveal a methodological problem, or help explain why established findings do not hold under particular conditions.
Conversely, a study with thousands of observations can ask a trivial question if the answer is already well established and the new analysis contributes no meaningful extension.
Scope size and research significance are therefore different dimensions.
Narrow scope
The study deliberately investigates a bounded population, phenomenon, setting, period, relationship, case, or body of evidence.
Trivial question
The answer has insufficient intellectual, empirical, methodological, practical, policy, or contextual value to justify the investigation as currently framed.
The first can be a methodological strength. The second is a problem of contribution.
The literature tells you whether your narrow question still contains uncertainty
A question can look interesting in isolation but become much less compelling after reviewing existing evidence.
Suppose dozens of robust studies have already established a particular relationship across comparable populations and settings. Repeating the same design in one additional convenient classroom may add little if there is no reason to expect the new context to challenge, refine, or meaningfully extend what is known.
That does not mean replication is trivial. Replication can test the robustness of previous findings, address uncertainty, examine generalizability, or evaluate whether an effect holds under theoretically relevant conditions. Research-question guidance explicitly recognizes confirmation, refutation, and extension of previous findings as forms of novelty.
The key is to articulate what the new study tests that remains uncertain.
A narrow question becomes more defensible when its relationship to existing evidence is clear: perhaps the prior studies used different populations, measures, contexts, interventions, periods, or analytical assumptions. The difference should matter conceptually or practically rather than merely provide a new address for essentially the same study.
Adding a new location does not automatically create a meaningful gap
One of the easiest ways to produce a narrowly framed question is to take an established relationship and change the location:
"This has been studied internationally but not in University X."
The absence of a study in a particular institution or locality is an observation about the literature. It is not automatically a compelling research gap.
The stronger question is why the new setting could matter. Does it have a different policy environment, student population, technological infrastructure, curriculum, institutional culture, socioeconomic context, implementation model, or other condition that could reasonably alter the phenomenon?
If yes, the local study may provide a meaningful contextual test or extension.
If no, "nobody has studied this here" may be a weak justification by itself.
Watch Out
Do not manufacture novelty by repeatedly shrinking geography. "No study has examined this exact relationship in this exact department at this exact institution" establishes uniqueness of location, not necessarily significance. Explain why the context could change what we know or why local evidence is needed for a consequential decision.
A local question can still be highly consequential
Local research should not be dismissed merely because it is geographically restricted.
Suppose a university is deciding whether to adopt a costly learning technology, redesign an academic-support program, revise an assessment policy, or intervene in a documented student problem. Evidence about that institution's population and context may have substantial practical value even if the findings are not intended to support universal claims.
The contribution is then partly decision relevance. The study provides evidence needed for a specific consequential decision.
Likewise, a local context may be theoretically important because it differs from the settings represented in previous research. Studying that context can test the boundary conditions of existing knowledge.
The appropriate question is not "Is this only local?" but "Why does evidence from this local context matter?"
A very specific population is not automatically trivial
Researchers sometimes worry that restricting a population makes the study unimportant. That depends on why the population is restricted.
A study of first-year nursing students may be narrow because those students are conveniently available. Or it may be narrow because first-year nursing students experience a particular educational transition central to the research problem.
The wording of the population is identical. The intellectual rationale is not.
A highly specific population can be valuable when it represents a theoretically meaningful subgroup, an understudied population, a group disproportionately affected by a problem, a population exposed to particular conditions, or a group for whom evidence is needed to guide practice or policy.
Restriction becomes harder to defend when the population is defined through increasingly arbitrary convenience criteria that have no relationship to the phenomenon being investigated.
Removing too many variables can turn an explanatory question into a descriptive fragment
Narrowing often involves reducing the number of variables or constructs. This can improve a study when unnecessary measures are removed. But it can also eliminate what made the question intellectually interesting.
Suppose the original problem concerns why students differ in their ability to use generative AI productively. After narrowing, the researcher measures only whether students have ever used generative AI.
The study is simpler, but the final variable may no longer capture the mechanism or outcome that motivated the research problem.
Similarly, if a theoretically important comparison, moderator, confounder, or explanatory construct is removed merely to simplify the project, the remaining question may provide an incomplete or misleading answer.
Good narrowing removes unnecessary complexity. It should not strip away the conceptual structure required to understand the problem.
Removing every comparison can eliminate the question you actually care about
Some research questions are inherently comparative. You may want to know whether two instructional approaches produce different outcomes, whether an intervention works differently for particular populations, or whether a phenomenon changes before and after a policy.
Removing one side of the comparison can make data collection easier. It also changes what the study can establish.
If the original question asks whether AI-assisted feedback differs from conventional feedback, studying only students receiving AI-assisted feedback cannot answer that comparative question. The study might still describe students' experiences or outcomes, but it has become a different investigation.
Narrowing improves research only when the remaining design still corresponds to the question being asked.
Repeated convenience restrictions are a warning sign
One practical way to recognize excessive narrowing is to inspect why each boundary was introduced.
| Reason for narrowing |
What to ask |
|
Theory
|
Does this boundary isolate the population, mechanism, condition, or relationship relevant to the theoretical question? |
|
Methodology
|
Does the restriction improve the study's ability to generate valid or interpretable evidence? |
|
Context
|
Does the boundary identify a setting whose characteristics matter to the phenomenon? |
|
Ethics
|
Is the restriction necessary to protect participants or maintain an ethically defensible design? |
|
Feasibility
|
Does the narrower question remain meaningful after being adapted to realistic resources? |
|
Convenience alone
|
Are boundaries accumulating simply because they make recruitment, measurement, or analysis easier? |
Feasibility is legitimate. Researchers do not have infinite time or funding. The warning sign is a sequence of restrictions justified only by convenience while the original claim to significance remains unchanged.
A question may be too narrow if its answer is almost predetermined
Research should address genuine uncertainty. If the question is framed so narrowly that the answer is effectively built into the definitions or conditions of the study, its value deserves scrutiny.
For example, asking whether students who report liking a particular learning tool report liking that tool within the same questionnaire would not produce much new understanding. The problem is not the small population or narrow setting. The problem is that the question offers little substantive uncertainty.
Likewise, a question may be technically testable but scientifically weak when the relationship is tautological, the outcome simply restates the predictor, or the answer follows almost entirely from how the variables have been defined.
A useful question should create the possibility of learning something that is not already guaranteed by its construction.
Statistical significance cannot rescue a trivial question
A very large dataset can detect small associations. A very narrowly framed analysis can also produce a statistically significant result. Neither fact establishes that the research question is important.
Statistical significance addresses evidence against a statistical null hypothesis under a specified model. It does not determine whether the effect is practically important, theoretically informative, educationally consequential, or worth the resources required to study it.
Researchers should therefore separate the question "Can I detect an association?" from "Would this association matter if it exists?"
This is especially important when narrowing has reduced the study to easily measured variables whose relationship has little substantive consequence.
A narrow study can contribute by testing boundary conditions
One powerful justification for narrowness is that the study examines where an existing finding stops holding.
Suppose previous research suggests that a particular instructional strategy improves learning. A new study focuses on novice learners completing a highly complex task under substantial time pressure. The population and context are narrow, but deliberately so: the study asks whether the established effect persists under theoretically important conditions.
This type of research can refine theory by identifying boundary conditions. It does not need broad coverage because its contribution lies precisely in the carefully chosen restriction.
A narrow study can contribute through depth
Not all contribution comes from estimating relationships across broad populations.
Qualitative, ethnographic, case-based, historical, and interpretive research may intentionally investigate a highly bounded case or context to produce detailed understanding unavailable through broader designs.
A single institutional case can illuminate implementation processes. A small participant group can reveal experiences overlooked by large surveys. Intensive analysis of a particular event can challenge assumptions about how a process operates.
Calling such research "too narrow" merely because it does not aim for statistical generalization applies the wrong standard. The question should instead be evaluated according to the methodology's purpose and the contribution the bounded inquiry can make.
Replication can be narrow without being redundant
A study does not need to investigate an entirely unprecedented topic to be valuable.
Replication may confirm, refute, or extend previous findings. A replication can be especially useful when prior evidence is uncertain, influential findings require verification, a different method provides a stronger test, or a theoretically relevant population or context has not been represented.
The crucial distinction is between replication with a reason and repetition without one.
If the study repeats an established finding in another convenient sample with no argument about robustness, generalizability, method, context, or decision relevance, its contribution may be difficult to articulate. If the new study provides a meaningful test of the existing evidence, narrow scope is not the problem.
Novelty does not require discovering something nobody has ever imagined
Researchers sometimes respond to concerns about triviality by trying to manufacture extreme novelty. That is unnecessary.
Research-question guidance treats novelty broadly. A study can contribute by confirming, refuting, or extending prior findings. It may apply an established explanation to a theoretically important new context, use stronger evidence to reassess an uncertain conclusion, investigate an understudied population, or resolve disagreement in the literature.
What matters is that the study adds something identifiable to the scholarly conversation.
"Nobody has combined these exact five variables before" is not automatically a contribution. Neither is "nobody has studied this exact institution." Novelty should be connected to a meaningful uncertainty rather than to the uniqueness of the study's coordinates.
Relevance asks who should care about the answer and why
The FINER criteria include relevance because a technically answerable question may still have little scientific or practical consequence. Research-question guidance describes relevance in terms of advancing knowledge and informing scientific, clinical, policy, or future research concerns, depending on the field.
For educational research, analogous questions might include:
- Would the answer change how we understand a learning process?
- Could it inform an instructional, assessment, technological, or institutional decision?
- Does it address an important population whose experiences or outcomes are poorly understood?
- Could it challenge, refine, confirm, or extend an existing explanation?
- Would it provide evidence needed before a larger or more definitive study?
If none of these applies and you cannot articulate another meaningful contribution, the question may need reconsideration.
A pilot or feasibility study has a different standard of contribution
A narrow project may be worthwhile because its purpose is not to answer the ultimate substantive question.
A pilot study might assess whether recruitment is possible, whether procedures can be implemented, whether an intervention can be delivered as intended, or whether measures function adequately before a larger study. In that case, a narrow scope can be appropriate because the research question concerns feasibility itself.
The mistake would be treating a small feasibility study as though it provided definitive evidence about effectiveness or broad population outcomes.
Significance should therefore be judged relative to the purpose the study actually claims.
The "so what?" test is useful, but it needs a real answer
A simple diagnostic is to imagine that the study has been completed exactly as planned and the findings are perfectly clear.
Then ask:
So what?
What changes because we know the answer? What uncertainty has been reduced? Which explanation becomes more or less plausible? What decision becomes better informed? Which population becomes better understood? What future research becomes possible?
Methodological guidance on research-question development explicitly recommends asking who the research will help and what benefit the answer provides.
If the only response is "because nobody has studied this exact combination before," the rationale may need more work.
If you can explain a concrete theoretical, empirical, methodological, practical, policy, or contextual consequence, the question may be narrow without being trivial.
Do not solve excessive narrowing by adding random breadth back in
Once researchers worry that a question is too narrow, the instinct may be to add another variable, population, institution, or method. That can simply recreate the original scope problem.
Instead, identify why the narrow question lacks significance.
If the population is arbitrary, choose one with theoretical or practical relevance. If the outcome is inconsequential, investigate an outcome that better represents the problem. If the setting contributes nothing new, identify what contextual characteristic would make the study informative. If previous research has already answered the question, determine whether replication, extension, a stronger design, or a different unresolved question is warranted.
The objective is not to make the study larger. It is to make the contribution clearer.
The right scope balances feasibility with contribution
Research-question development involves several criteria simultaneously. A question should be manageable enough to investigate but sufficiently interesting, novel, and relevant to justify doing so. These criteria can pull in different directions.
A broad study may have obvious significance but be impossible to execute. A very narrow study may be easy to complete but difficult to justify. The strongest question occupies a defensible position between those extremes.
| Focused but still meaningful |
Possibly narrowed too far |
| The population is narrow because it is theoretically or practically important |
The population is narrow only because it is easiest to access |
| The setting tests a meaningful contextual difference |
The setting is presented as novel merely because no identical local study was found |
| Variables represent the mechanism or outcome central to the problem |
Variables have been reduced to what is easiest to measure rather than what matters |
| A small case permits depth or examination of an important process |
The case is so restricted that no clear analytical or practical purpose remains |
| Replication tests robustness, generalizability, or an unresolved finding |
The study repeats an established result without explaining what the repetition contributes |
| The study answers a consequential local decision |
The study has no identifiable audience or decision that would benefit from the answer |
This balance is why deciding how narrow a study should be requires more than a feasibility calculation. The study needs to remain answerable and worth answering.