03 · What You Need to Know
The Boundary Depends on Integration, Not Size
A study should have a recognizable intellectual center
A coherent study usually has a central problem or question that explains why its major components belong together. Methodological guidance on research-question development emphasizes that the research question guides study design and that primary and secondary objectives should be clearly defined. Feasibility also includes keeping the project manageable in scope.
That does not require every study to have only one narrowly phrased question. A primary question may have secondary questions. A qualitative project may explore several dimensions of one phenomenon. A mixed-methods design may use different forms of evidence. A longitudinal project may examine several related outcomes.
The more useful test is whether you can explain, in one coherent argument, what problem the complete design is intended to resolve.
If the only explanation connecting the components is "they are all about artificial intelligence," "they all concern students," or "they all use the same dataset," the intellectual center may be too weak.
A broad topic can contain an entire research program
Suppose your broad interest is generative AI in higher education. Within that area, you could investigate:
- how students use generative AI for academic writing;
- whether AI-assisted feedback affects learning outcomes;
- how faculty members make decisions about permitted AI use;
- how universities formulate AI policies;
- whether access to paid AI tools creates inequities;
- how employers perceive AI-assisted student work.
These questions belong to the same broad scholarly area. They do not automatically belong in the same empirical study.
Each could involve a different population, body of literature, theoretical perspective, form of evidence, and methodological design. Together they may constitute a research program: a connected sequence of studies investigating different dimensions of a larger problem.
Recognizing this distinction can be liberating. You do not have to answer every important question in one protocol for the questions to remain intellectually connected.
Multiple research questions do not automatically create multiple studies
Counting questions is a poor diagnostic.
A study could contain one primary question and several secondary questions that use the same participants, measures, design, and conceptual model. Those questions may form one coherent investigation.
Conversely, two questions can effectively require two studies.
Consider:
Question A: Is generative AI use for academic writing associated with writing self-efficacy among first-year students?
Question B: How do university administrators develop institutional policies governing generative AI?
Only two questions are present, but they concern different populations, phenomena, evidence, literatures, and analytical approaches. Their common interest in generative AI does not make them methodologically dependent.
Research-question guidance warns that multiple primary questions can create feasibility problems because different questions may require different designs and greater sample-size or analytical demands. The broader lesson is that each substantive question creates methodological obligations.
Look for clusters of questions that require their own populations
A particularly strong signal appears when different questions require different populations.
Suppose one cluster concerns students, another concerns faculty members, and another concerns university administrators. Multiple populations can certainly belong in one study, particularly when comparison or integration across perspectives is central to the research problem.
But ask why the populations need to be studied together.
If student experiences, faculty practices, and administrative policies are intentionally examined as interacting components of institutional AI governance, a multi-stakeholder design may be coherent.
If each population simply answers a different question about AI, separation may provide clearer research designs.
The presence of multiple populations is therefore not the deciding factor. The question is whether their evidence must be brought together to answer something that none of the populations can answer independently.
Different methods do not automatically mean different studies
A survey plus interviews is not automatically two studies.
In an integrated mixed-methods design, quantitative and qualitative components can address complementary aspects of the same research problem. Interviews might explain a quantitative pattern, help interpret unexpected findings, or investigate mechanisms that numerical measures cannot adequately capture.
The methods then have an explicit relationship.
By contrast, imagine surveying students about AI use and separately interviewing administrators about university procurement procedures. If the two datasets answer independent questions and are never meaningfully integrated, calling the project "mixed methods" does not itself create methodological unity.
Multiple methods within one study
Different forms of evidence are intentionally connected to answer complementary parts of a common research problem.
Several studies using different methods
Each methodological component addresses a question that can stand largely on its own and does not require integration with the other components.
Ask whether each component could stand alone as a defensible study
This is one of the most useful diagnostic tests.
Take each major component and imagine removing all the others.
Would the student survey still have a complete research question, literature rationale, methods, analysis, and interpretable answer?
Would the faculty interviews still constitute a coherent qualitative study?
Would the policy analysis still answer a meaningful documentary research question?
If each component remains intellectually complete and the findings do not need to be integrated to answer a higher-order question, you may be looking at several related studies.
This does not mean they must be separated. Some multi-study projects intentionally combine self-contained studies to address a larger programmatic question. But recognizing their independence helps you design and report the project accurately.
Ask the reverse question: what would be lost by separating them?
The stand-alone test should be paired with its opposite.
Suppose you split the proposed project into two studies. What important inference becomes impossible?
If separation destroys the central comparison, prevents necessary integration of evidence, or makes the overarching question impossible to answer, keeping the components together may be justified.
If almost nothing is lost except the convenience of having one project title, separation deserves serious consideration.
This test prevents an overly aggressive approach in which every methodological component is automatically turned into a separate paper or project. Integration should be preserved when it serves the research question.
Independent literature bases are another warning sign
Look at what literature is needed to justify each component.
A study of student writing self-efficacy may draw on scholarship about self-efficacy, writing, learning, and generative AI use. A study of institutional AI policy may require literature on governance, organizational policy, academic integrity, and institutional decision-making.
Interdisciplinary research can legitimately connect distinct literatures. The question is whether the connection produces an integrated conceptual argument.
If each question needs its own largely independent literature review and conceptual framework, and those frameworks never interact, the project may contain several studies.
Independent theoretical frameworks can reveal separate inquiries
A similar issue arises when each component requires a different theory.
Suppose student adoption is analyzed through a technology-acceptance framework, faculty practice through teacher agency, and institutional policy through organizational governance theory.
That could form an ambitious multilevel study if the theoretical perspectives are deliberately connected to explain a common phenomenon across levels.
But simply placing three frameworks under one conceptual-framework heading does not create integration. If each theory explains only its own population and no cross-level relationship is examined, the components may be parallel studies rather than one theoretical model.
Theories should clarify why components belong together, not serve as decorative stitching between independent questions.
Different units of analysis can indicate another study is emerging
One question may analyze individual students. Another analyzes courses. Another analyzes universities. Another analyzes policy documents.
Multiple units of analysis can be entirely appropriate in multilevel, comparative, case-based, or mixed-methods research. But they create distinct evidential structures that need explicit integration.
Ask whether the design explains how evidence at one level relates to evidence at another.
If institutional policy is used to contextualize student behavior, for example, the units may be intentionally connected. If the policy documents answer an unrelated question about legal language, that analysis may constitute another study.
Independent sampling strategies can reveal methodological separation
Consider how each component obtains evidence.
Student participants may be selected through probability sampling. Faculty participants may be recruited purposively. Institutions may be selected as comparative cases. Policy documents may be included through predefined documentary criteria.
Again, different sampling approaches are not inherently problematic. They may be exactly what a complex design requires.
The warning sign is that each component has its own population, eligibility logic, sample-size or information-adequacy considerations, recruitment procedures, and analytical goals without a clear explanation of why the resulting evidence needs to converge.
Independent analyses can make the project look like a bundle of studies
Imagine a project with:
- a regression analysis of student survey data;
- a thematic analysis of faculty interviews;
- a content analysis of institutional policies;
- a bibliometric analysis of AI-in-education publications.
Using several analytical methods can be methodologically sophisticated. It can also be four studies sharing a folder.
Ask what happens after each analysis is completed. Is there an explicit integration stage? Do findings from one component inform interpretation of another? Does the overarching conclusion depend on combining them?
If the final report simply presents four sets of results consecutively, integration may be nominal rather than substantive.
One dataset can contain several studies
The reverse situation also occurs: several studies can use the same dataset.
A large longitudinal dataset might support one study of academic performance, another of student retention, and another of technology adoption. Shared data do not make the questions one study if each analysis addresses a distinct research problem.
This is especially important with secondary data. Researchers can mistake common data provenance for common intellectual purpose.
What makes studies distinct is not necessarily separate data files. It is the relationship among questions, hypotheses or objectives, analytical purposes, and intended contributions.
One participant sample can also support more than one study
Likewise, using the same participants does not automatically make every question part of one study.
A cohort may contribute data to several planned investigations. A survey may contain measures supporting distinct analyses. A longitudinal project may generate multiple research outputs addressing different questions.
Whether these constitute one study, substudies, secondary analyses, or separate studies depends partly on the protocol, design, governance, and disciplinary conventions.
The conceptual lesson remains: shared participants reduce logistical separation, but they do not automatically establish conceptual integration.
Multiple primary questions deserve particular scrutiny
A project with several questions is easier to defend when one central question clearly organizes the rest. Several equally primary questions can create more difficulty.
Research-methodology guidance recommends clearly defined primary and secondary objectives, and some clinical research guidance explicitly warns that several primary questions may require different designs and sample-size requirements.
This does not mean every discipline must label one question "primary." Exploratory qualitative studies, for example, may not use that hierarchy in the same way.
The transferable principle is that a study should have a coherent purpose. If several questions compete for equal methodological priority and each could justify its own design, consider whether one project is carrying several investigations.
Feasibility can be the practical reason to separate intellectually related studies
Even when several components could logically be integrated, the combined project may exceed available capacity.
The FINER framework identifies feasibility as a criterion for a good research question, including adequate participants, expertise, time, funding, and manageable scope.
A multi-population, multi-site, multi-method project might answer an important integrated question, but a single researcher may not have the resources to execute every component rigorously.
Separating the project can allow each question to receive adequate sampling, measurement, analysis, and interpretation rather than forcing all components into a superficially comprehensive study.
This is not merely project management. It can be a methodological decision about the quality of evidence each question receives.
Do not split a study merely to create more publications
The opposite temptation deserves equal caution.
Separating conceptually inseparable pieces of one study solely to increase the number of publications can fragment the scientific story and create redundant reporting. Publication ethics discussions commonly refer to inappropriate fragmentation as redundant or "salami" publication, although determining what constitutes inappropriate fragmentation depends on the degree of overlap and whether each paper addresses a substantively distinct question.
A defensible separation should therefore occur because the questions genuinely warrant independent treatment, not simply because one dataset can be divided into several manuscripts.
Watch Out
There are two opposite errors: forcing several independent investigations into one overloaded study and artificially slicing one coherent investigation into multiple minimally distinct outputs. Separate questions when each has a genuine intellectual and methodological identity, not merely to make the project smaller or the publication list longer.
Separate studies can still be intentionally connected
Splitting a project does not require abandoning the larger research problem.
You might design a sequence:
Study 1: characterize student use of generative AI for academic writing.
Study 2: investigate faculty decision-making about AI-assisted writing.
Study 3: analyze institutional AI policies.
Study 4: integrate findings from the preceding studies to develop or test a broader explanatory framework.
This programmatic structure can be stronger than attempting to perform all four investigations simultaneously without adequate depth.
Later studies can also be informed by earlier findings. A survey can identify patterns requiring qualitative explanation. Qualitative findings can inform an intervention. An institutional case can motivate a multi-site comparison.
Research does not lose coherence merely because its questions unfold across several studies.
A sequence of studies can sometimes provide stronger evidence than one enormous design
Separating questions can create methodological advantages.
The first study can establish whether an assumed phenomenon actually exists. A second can investigate mechanisms. A third can test an intervention based on those mechanisms. A fourth can examine generalizability in another context.
Each study then has a research question appropriate to its stage of knowledge development.
This can be preferable to designing a single project that attempts description, explanation, intervention, and generalization simultaneously before the foundational questions have been answered.
But some questions genuinely require one integrated design
Do not interpret separation as the default solution to complexity.
A mediation study may need exposure, mediator, and outcome in one coherent design. A mixed-methods explanatory sequence may require qualitative follow-up to interpret quantitative findings. A multilevel study may need individual and institutional evidence simultaneously. A comparative case study may require several cases because comparison itself is the research strategy.
Separating these components could destroy the inference the study is designed to make.
The decisive question remains: Does the answer depend on the components being investigated together?
The boundary can be tested with five forms of dependence
| Type of dependence |
One integrated study is more plausible when... |
Several studies are more plausible when... |
|
Conceptual
|
The components address parts of one explanatory or interpretive problem |
Each component has a largely independent research problem |
|
Evidential
|
Evidence from one component is needed to interpret or answer another |
Each dataset can support its conclusions independently |
|
Methodological
|
The design explicitly connects phases, populations, cases, or methods |
Each component requires a largely self-contained design |
|
Analytical
|
Integration or joint analysis is necessary for the main inference |
Analyses remain independent and produce separate conclusions |
|
Programmatic
|
The complete study can be executed rigorously within available capacity |
Combining the components compromises feasibility or depth |
No single row determines the answer. The pattern across them is more informative.
The point of separation is better research, not tidier administration
Dividing one oversized project into several studies should improve how the questions are investigated.
Each resulting study should have a meaningful question, appropriate population or evidence, suitable methodology, adequate analysis, and identifiable contribution. If separation produces fragments that cannot stand intellectually on their own, the original integration may have been necessary.
Conversely, if each resulting study becomes clearer and more defensible once separated, the original project may have been carrying more than one inquiry.