03 · What You Need to Know
The Conceptual Foundation Should Constrain the Design Without Predetermining It
Research design is not merely a technical stage that begins after the intellectual work is complete. The conceptual and methodological dimensions of a study influence one another. Thinking about evidence can reveal an ambiguous construct. Considering sampling can expose an overly broad population. Evaluating possible measures may reveal that two concepts treated as equivalent in the literature review are actually distinct.
Still, you need enough conceptual structure before detailed methodological decisions become meaningful.
You should be able to state the research problem precisely
Begin with the reason the study exists.
Can you explain what is insufficiently understood, unresolved, contradictory, problematic, or otherwise in need of investigation? Can you distinguish that problem from the broad topic?
“Generative AI in higher education” is a topic. “How university instructors interpret ambiguous institutional boundaries between permitted and prohibited generative AI assistance when designing assessments” points toward a more specific inquiry.
The problem does not need to be reducible to one sentence, but its central logic should be identifiable. If different paragraphs in your problem statement appear to justify substantially different studies, detailed design may be premature.
The research question should follow from the problem
A clear problem does not help much if the research question investigates something else.
Before moving forward, ask whether answering the question would actually contribute to investigating the problem that justified the study. This is the central test of problem-question alignment.
You should also know what kind of answer the question seeks. Description, comparison, association, interpretation, explanation, process, prediction, and causal inference impose different demands on the eventual design.
If you are still changing between “What do participants think?”, “What predicts the outcome?”, and “Does the intervention cause improvement?”, the study has not merely undergone minor wording changes. Its evidentiary requirements are changing substantially.
Your central concepts should be clear enough to recognize what would and would not count as evidence
Conceptual clarity does not mean finding the one universally correct definition of every term. Many research constructs have competing definitions.
It means knowing how a concept is being used in your study and why.
If you intend to study “research impact,” for example, are you referring to citation influence, scholarly uptake, policy use, professional practice, societal change, or some broader conception? Those possibilities may overlap, but they are not empirically interchangeable.
A useful readiness test is whether you could look at a proposed measure, interview question, observation, document, or database field and explain whether it provides evidence about the concept you mean.
If almost anything related to the topic could count, the concept may still be too vague to guide design.
The framework should have an identifiable role
When a theoretical or conceptual framework is appropriate, you should be able to explain what it contributes.
Does it define constructs? Propose relationships? Explain a mechanism? Identify contextual conditions? Provide an interpretive lens? Organize concepts from the literature?
You do not need the framework to dictate every methodological decision. But if you cannot explain how it relates to the question, it may not yet be functioning as part of the study's conceptual foundation.
The useful test is whether the framework actually helps you investigate or interpret the research question rather than merely demonstrating familiarity with theory.
You should know what evidence a convincing answer would require
This is perhaps the most practical transition point between conceptualization and design.
Complete this sentence for each research question:
To answer this question convincingly, I would need evidence showing...
Do this before naming a particular instrument.
If the question asks about a relationship between constructs, you need appropriate evidence representing those constructs. If it concerns change, the evidence must address change in some defensible way. If it concerns participants' interpretations, the study needs appropriate access to those interpretations. If it makes a causal claim, the evidentiary and design requirements become more demanding.
Once you can specify the evidence the question requires, research design has something concrete to solve.
You do not need to have selected the final method yet
Being ready for research design does not mean already knowing that you will conduct 20 interviews, administer a particular scale, fit a specific regression model, or use a particular qualitative analytical approach.
Those are design decisions.
The conceptual foundation should tell you what the design must accomplish, but there may be several legitimate ways to accomplish it.
Conceptual requirement
The study needs evidence about how students interpret feedback while making revision decisions.
Design decision
Which participants, artifacts, interviews, observations, elicitation procedures, or other methods can credibly provide that evidence within the chosen methodology?
Keeping this distinction visible helps prevent methodological familiarity from driving the question.
You should know the important boundaries of the inquiry
A study becomes designable when you know not only what it investigates but also what it does not attempt to investigate.
Which population or cases matter? What setting is relevant? Which constructs are central? What relationships are within scope? What forms of impact or outcome are excluded? What temporal boundaries matter?
These decisions need not all be permanently fixed, but unresolved scope can make sampling and evidence planning unstable.
If the conceptual framework contains many more components than the study can reasonably examine, decide which parts of the framework are actually within the study's empirical scope before designing data collection around the whole model.
Important assumptions should be visible enough to question
Every study contains assumptions. Some are theoretical, such as expecting that one construct influences another. Others concern measurement, context, participants, or what particular evidence can represent.
You do not need to eliminate assumptions. You need to recognize consequential ones.
For example, if your question assumes that “responsible AI use” can be represented by self-reported adherence to institutional guidelines, that assumption will shape measurement. It deserves examination before an instrument is built around it.
An assumption that remains invisible cannot easily be tested, justified, or bounded.
You should be able to explain why the study is not a neighboring study
A surprisingly useful readiness test is to compare your proposed inquiry with adjacent possibilities.
Why are you studying instructors' interpretations of an AI policy rather than their compliance with it? Why are you examining behavioral intention rather than actual adoption? Why are you investigating students' perceptions of feedback rather than its effect on achievement?
If those distinctions are clear, the conceptual boundary is becoming stable enough to guide design.
If the alternatives still feel interchangeable, more conceptual work may be useful before investing heavily in methods.
The literature review should support decisions, not merely continue accumulating
There is no magical number of sources indicating that the conceptual foundation is complete.
The relevant question is whether additional literature is still changing the central architecture of the study.
If new sources continue to reveal that you have misunderstood the construct, overlooked a major competing explanation, or formulated the problem incorrectly, further conceptual work is warranted.
If new sources largely refine details without changing the problem, question, conceptual relationships, or evidence requirements, the marginal value of postponing design may be declining.
Literature saturation in this practical sense should not be confused with formal notions of saturation used in some qualitative methodologies. The point is simply that reading indefinitely is not a substitute for designing the study.
Conceptual readiness is not conceptual perfection
Waiting for complete conceptual certainty can become its own form of avoidance.
Research is designed partly because important things remain uncertain. The framework may later be refined. Definitions may need adjustment. Pilot work may reveal that participants understand a concept differently from the literature. Feasibility may force narrower boundaries.
The relevant threshold is not “nothing could possibly change.”
It is “the current conceptual structure is defensible enough that methodological decisions can now be evaluated against it.”
Use methodological planning as a stress test
Once the foundation appears ready, begin sketching the design and watch what happens.
Can you identify plausible evidence sources? Can those sources provide what the question requires? Can you imagine an analysis capable of producing the intended answer? Are the population and context accessible? Are the ethical implications manageable?
If design planning exposes a local issue, revise it locally. If every methodological option produces contradictions, the conceptual foundation may not be ready after all.
This is why moving into design is not a one-way door. Sometimes you need to return to the foundation instead of continuing to patch the methods.
Watch Out
Do not use “I need to read more” as an indefinite substitute for making research decisions. More literature is useful when it can plausibly change or strengthen the problem, question, concepts, framework, or evidence requirements. Once those elements are sufficiently defensible, design itself becomes a way of testing whether the conceptual foundation holds together.