03 · What You Need to Know
A good research plan is stable where it matters and flexible where it helps
Planning is sometimes imagined as an exercise in eliminating uncertainty. Under that view, a good researcher decides everything before beginning and then executes the plan without deviation.
That is too simple.
Research involves uncertainty by definition. Access conditions change. Recruitment may be slower than expected. An interview may reveal an important issue that was not anticipated. A pilot test may expose confusing instructions. New information may make one operational procedure preferable to another. In some methodologies, learning from early observations and allowing that learning to inform subsequent inquiry is part of the design itself.
At the same time, unlimited flexibility would make it difficult to know what study was actually conducted. If every important decision can change after researchers have seen the emerging data, choices may become influenced by the very findings the study is supposed to evaluate independently.
The objective is therefore not maximum flexibility. It is controlled flexibility.
Separate the scientific core from the operational details
One useful starting point is to distinguish decisions that define the scientific logic of the study from decisions about how that logic will be implemented in practice.
The scientific core may include the research question, intended claims, population or phenomenon of interest, broad design, central outcomes or concepts, comparison logic, and the evidence needed to answer the question. These elements usually require greater stability because changing them can change what study you are conducting.
Operational details include matters such as scheduling, division of routine tasks, some recruitment logistics, file organization, meeting arrangements, or the sequence in which independent administrative tasks are completed. These may often be adjusted without changing what the study means.
Scientific flexibility
A change affects what is studied, what evidence counts, how evidence is generated or interpreted, or what claims the study can support.
Operational flexibility
A change affects how the work is organized or implemented without materially altering the scientific meaning, participant protections, or validity of the study.
The boundary is not always clean. A recruitment change that initially appears operational, for example, could become scientific if it substantially changes who enters the sample. This is why decisions should be evaluated by their consequences rather than by their labels.
Some scheduling decisions can remain provisional
Early research timelines rarely need every activity assigned to an immutable date. Exact interview appointments, team meetings, internal review dates, transcription batches, or the order of independent administrative tasks may remain adjustable.
What matters more is knowing the major dependencies and constraints. If data collection cannot begin before ethics approval, that dependency needs to be recognized even if the approval date is unknown. If a thesis must be submitted by a fixed deadline, the preceding stages need enough structure to make that deadline plausible even though individual workdays remain flexible.
This distinction becomes useful when you break the project into manageable stages. Milestones and dependencies can provide structure without requiring a fictional level of precision about exactly when every task will occur.
Some logistical choices can change without changing the study
Many projects have practical details that can reasonably evolve. You may adjust how team responsibilities are distributed, which days interviews are scheduled, how often researchers meet, the order in which sites are contacted, or which approved recruitment channel receives greater effort.
These decisions still need management. Flexibility should not become an excuse for leaving responsibilities ambiguous or deadlines invisible. The point is that revising such choices generally does not alter the scientific interpretation of the study.
A simple test is to ask: If I change this decision, would a knowledgeable reader need to reinterpret the study's findings? If the answer is no, the decision may be primarily operational. If the answer is yes, it deserves closer methodological scrutiny.
Qualitative data collection may include planned responsiveness
Some qualitative approaches intentionally permit researchers to refine questions, pursue emerging lines of inquiry, adjust sampling, or develop analytical categories as understanding grows. In such work, forcing every detail to remain identical from the first participant to the last may be inconsistent with the methodological logic.
For example, a semistructured interview guide normally provides direction without requiring every interview to consist of identical questions asked in identical words and order. Researchers may use follow-up probes when participants raise relevant experiences that need clarification.
That does not mean anything goes. The study still needs a coherent research purpose, an appropriate methodological framework, documented procedures, ethical safeguards, and enough consistency to support credible interpretation. If an adaptation changes approved recruitment, consent, risk, data collection, or other regulated aspects of human-participant research, applicable review requirements must also be followed.
Exploratory analysis can legitimately preserve choices that confirmatory analysis should settle earlier
Flexibility also depends on what kind of claim you intend to make.
Exploratory research may legitimately examine patterns, generate hypotheses, compare alternative explanations, or investigate unexpected relationships. It would be counterproductive to pretend that every exploratory question was specified before the data were examined.
Confirmatory analysis presents a different problem. If researchers select outcomes, comparisons, exclusion criteria, transformations, or models after seeing which choices produce favorable results, the apparent strength of the evidence can be exaggerated.
| Decision |
Can it remain flexible early? |
Important qualification |
| Exact dates for many internal tasks |
Often |
Major deadlines and dependencies still need to be realistic. |
| Routine division of team workload |
Often |
Critical responsibilities should still have clear ownership. |
| Semistructured interview probes |
Often |
Adaptation should remain relevant to the research purpose and comply with applicable approvals. |
| Qualitative codes and categories |
Often |
Many qualitative approaches develop these iteratively, but the analytic process should be transparent and methodologically defensible. |
| Exploratory analytical questions |
Often |
They should be reported honestly as exploratory rather than retrospectively presented as prespecified hypotheses. |
| Primary outcome in a confirmatory study |
Usually not once the relevant commitment point is reached |
Changing it after examining results can alter the interpretation and credibility of the evidence. |
| Eligibility criteria during recruitment |
Requires caution |
Changes may alter the sample and may require protocol or ethics review. |
| Consent or participant-risk procedures |
Not informally |
Changes may require prior review and approval under applicable rules. |
The key is transparency. A decision that was genuinely exploratory should not later be described as though it had always been fixed. Flexibility and credibility can coexist when the timing and rationale for decisions are clear.
Piloting exists partly because some decisions should not be finalized too early
A pilot or feasibility exercise may reveal that instructions are misunderstood, an instrument takes too long, recruitment channels are ineffective, equipment behaves differently in the field, or a procedure imposes more burden than anticipated.
If the purpose of piloting is to learn whether a procedure works, insisting that the procedure cannot change afterward would defeat much of the point.
The important distinction is between using preliminary work to improve the eventual study and modifying the main study after relevant outcome information has accumulated. The latter can have different implications for bias, analysis, documentation, and approval.
Sampling flexibility depends heavily on methodology
Sampling is another area where universal rules fail quickly.
In some quantitative studies, sampling procedures and sample-size targets need substantial advance specification because they affect representativeness, precision, statistical power, or inferential validity.
Some qualitative methodologies instead use iterative or theoretically informed sampling. Decisions about whom to recruit next may depend partly on what earlier data suggest is needed to deepen, challenge, or elaborate the developing analysis.
Neither approach is inherently more rigorous. The important question is whether the flexibility is consistent with the methodology and whether researchers can explain why sampling decisions were made.
Analysis may evolve, but that does not make every analytical change equivalent
Researchers often learn things about their data only after they begin working with them. Variables may have unexpected distributions. Missingness may be more extensive than anticipated. Qualitative material may require refinement of a coding framework. A planned model may prove inappropriate because its assumptions are not satisfied.
Some analytical adaptation may therefore be necessary.
The methodological issue is not simply whether the analysis changed. Ask why it changed, when the decision was made, whether the researchers had already seen relevant results, and whether alternative choices could materially change the conclusions.
A defensible response to an assumption violation is different from repeatedly trying analyses until one produces the desired result. Likewise, refining qualitative codes as interpretation develops is different from removing inconvenient material because it complicates an emerging narrative.
Flexibility decreases as decisions become harder to reverse
Research decisions have different commitment points. Early in planning, changing the intended recruitment method may cost little. After hundreds of participants have been recruited through one channel, the same change may have consequences for sample composition and interpretation.
This creates a useful general principle:
The closer a decision gets to affecting participants, generating irreversible data, consuming substantial resources, or determining the interpretation of results, the stronger the case for resolving and documenting it.
That is why decisions that should be fixed before data collection deserve separate attention. Data collection is a major commitment point because information that was never collected often cannot be reconstructed later.
Ethics approval creates boundaries around what can be changed informally
For human-participant research, researchers should not assume that an approved protocol is merely a rough starting point.
Under U.S. Department of Health and Human Services regulations applicable to covered research, changes to approved research generally may not be initiated without prior Institutional Review Board review and approval, except when necessary to eliminate apparent immediate hazards to participants. NIH's own IRB guidance similarly requires modifications to approved protocols, consent forms, study tools, recruitment materials, and related documents to be submitted and approved before implementation, subject to the immediate-hazard exception.
Requirements differ across jurisdictions and institutions, so researchers should follow the rules governing their own study. The broader planning lesson is transferable: methodological flexibility does not override ethics, regulatory, institutional, contractual, or funder requirements.
Watch Out
Do not implement a scientifically sensible change to human-participant research merely because it seems minor. If the activity is governed by an approved protocol, first determine whether the change requires review, approval, notification, or updated participant materials under the rules that apply to the study.
A research plan can be a living document without becoming an unreliable document
Plans sometimes need revision because the project changes. That does not make planning pointless. A useful plan records the best current decisions while making subsequent changes visible.
NIH's current Data Management and Sharing guidance provides a concrete example. Investigators submit plans prospectively, but NIH recognizes that they may need revision during a project, such as when the type of data changes or a more appropriate repository becomes available. Current NIH requirements specify how such changes are to be reported for covered awards.
The principle extends beyond data management. When an important research decision changes, record what changed, why it changed, when it changed, and what consequences the revision has for the rest of the project. The appropriate documentation may range from an internal decision log to a formal protocol amendment, depending on the study.
If substantial changes become necessary, the question shifts from what can remain flexible to what you should do when the research plan changes.
Do not use flexibility to postpone foundational decisions
There is an important difference between intentionally leaving a decision open and simply not having thought about it.
If you do not yet know whether you can access the required data, whether the project is ethically permissible, what population the question concerns, or what kind of evidence could answer it, these are not necessarily examples of healthy flexibility. They may indicate that foundational planning remains unfinished.
The broader set of decisions that should be made before starting research provides the boundary. Flexibility should operate within a sufficiently coherent study, not substitute for having one.