01 · The Question
Does Scientific Research Require an Experiment?
The experiment occupies a prominent place in popular images of science: researchers manipulate something, control other conditions, compare groups, and observe what happens. Experimental designs can indeed provide unusually strong evidence for certain questions, particularly when researchers want to estimate causal effects.
But scientists routinely investigate questions for which experimental manipulation is unnecessary, impractical, unethical, or simply impossible. Astronomers cannot assign planets to different solar systems. Epidemiologists cannot deliberately expose people to many suspected hazards. Ecologists often study naturally occurring environments. Social scientists may investigate events, institutions, populations, and behaviors they do not control.
If experimentation were required for science, substantial areas of established scientific inquiry would become difficult to classify as scientific. The more useful question is therefore what makes an investigation scientific in the first place.
03 · What You Need to Know
Why Science Is Not Defined by Experimentation Alone
An experiment is one research strategy, not the definition of science
In an experiment, researchers deliberately manipulate or assign an intervention, exposure, treatment, or condition and examine resulting outcomes. The precise definition and design conventions vary among disciplines, but researcher-controlled intervention or assignment is a central distinction between experimental and observational designs.
For example, the U.S. National Institutes of Health defines a clinical trial as a research study in which human participants are prospectively assigned to one or more interventions so that researchers can evaluate effects on health-related biomedical or behavioral outcomes. NIH separately recognizes observational studies in which researchers gather data from or about participants without performing an intervention.
Both are forms of research. The difference concerns how evidence is generated, not whether one activity is inherently scientific and the other is not.
Experimental research
The researcher deliberately assigns or manipulates a condition or intervention in order to investigate its effects.
Observational research
The researcher studies naturally occurring exposures, characteristics, events, or outcomes without assigning the intervention or exposure of interest.
Scientific questions are not all causal questions
An experiment would be unnecessary for many legitimate scientific questions because the purpose is not to determine the effect of an assigned intervention.
A researcher might ask how common a condition is, how a population changes over time, whether two naturally occurring characteristics are associated, how a disease progresses without a particular intervention, what patterns appear in an ecosystem, or how an astronomical phenomenon behaves. These questions can require systematic observation and analysis rather than experimental manipulation.
This is closely related to why careful description can itself constitute research . A method should be selected because it can answer the question, not because it resembles the stereotypical image of laboratory science.
Some important questions cannot ethically be studied experimentally
Randomized experiments can sometimes strengthen causal inference because assignment procedures help address alternative explanations. Yet deliberate assignment may be ethically unacceptable.
Suppose researchers want to investigate whether long-term exposure to a harmful substance is associated with disease. Randomly assigning people to sustained harmful exposure simply to observe whether they become ill would be ethically indefensible. Researchers may instead use observational evidence from exposures that occur independently of the study.
Similar constraints arise when studying many environmental hazards, adverse childhood experiences, harmful behaviors, disasters, socioeconomic conditions, and diseases. The inability to manipulate these phenomena does not make systematic investigation of them unscientific.
Some phenomena cannot realistically be manipulated
Other research questions concern events or conditions beyond researchers' control. Scientists cannot experimentally create earthquakes of the necessary scale, assign countries to political histories, rearrange galaxies, or rerun historical events under alternative conditions.
Researchers can nevertheless collect observations, compare cases, measure patterns, construct and test models, evaluate predictions, examine competing explanations, and revise conclusions when evidence changes.
Scientific reasoning therefore cannot be reduced to the instruction "conduct an experiment." This is one reason there is no single scientific method that every research project must follow .
Observational research can be descriptive or analytical
Nonexperimental research should not be equated with passive description. Observational studies may simply characterize a phenomenon, but they can also examine associations, compare naturally occurring groups, investigate risk factors, study trajectories over time, and evaluate evidence relevant to explanatory questions.
Common observational designs in health research, for example, include cohort, case-control, and cross-sectional studies. Researchers may collect data prospectively or analyze information gathered previously. NIH also recognizes natural history studies and secondary research among forms of observational studies involving humans.
The important limitation is that the absence of experimental control can make some causal interpretations more difficult. Confounding, selection processes, measurement problems, reverse causation, and competing explanations may need careful consideration. The appropriate response is not to dismiss observational evidence, but to match the strength of the conclusion to the strengths and limitations of the design.
Even experiments do not automatically produce strong science
Calling a study experimental does not guarantee rigor. An experiment can use poor measurements, inadequate controls, inappropriate analyses, weak manipulations, biased sampling, selective reporting, or conclusions that extend beyond the evidence.
Conversely, a carefully designed observational study can use transparent procedures, strong measurement, appropriate sampling, thoughtful analysis, sensitivity checks, and explicit treatment of alternative explanations.
The relevant question is therefore whether the research is systematic and rigorous in ways appropriate to its question and method , rather than whether an experiment appears somewhere in the methods section.
Experimental and nonexperimental evidence often complement each other
Scientific understanding frequently develops through multiple research designs rather than a single decisive study. Experiments may isolate the effects of interventions under particular conditions, while observational studies can examine naturally occurring variation, long-term patterns, uncommon outcomes, broader populations, or situations that cannot be assigned experimentally.
Evidence from different approaches may converge, conflict, or expose limitations in previous conclusions. That methodological diversity can be a strength because different designs are vulnerable to different sources of uncertainty.
The broader OECD framework for research and experimental development also makes clear that research is not synonymous with experimental design. Its internationally used framework encompasses basic research, applied research, and experimental development as distinct forms of R&D activity rather than defining all research as experimentation.
04 · A Practical Example
Studying Air Pollution Without Assigning Harmful Exposure
Hypothetical Example
Does greater air-pollution exposure correspond with poorer respiratory outcomes?
Suppose researchers investigate whether people living in areas with different levels of air pollution show different respiratory outcomes. The researchers do not assign anyone to breathe polluted air. Instead, they measure or estimate naturally occurring exposure and examine health data using an appropriate observational design.
Question Are differences in long-term air-pollution exposure associated with differences in respiratory outcomes?
Design Researchers observe naturally occurring exposure rather than experimentally assigning it.
Analysis They evaluate the association while considering plausible confounding factors, measurement uncertainty, selection processes, and other limitations relevant to the design.
Conclusion They report conclusions at a level justified by the observational evidence rather than claiming that the design possesses experimental control it does not have.
The absence of an experiment is not a methodological failure here. Deliberately exposing participants to harmful pollution would raise obvious ethical problems. An observational design is not merely a fallback version of an experiment; it is the appropriate way to investigate many naturally occurring exposures.
What researchers may infer from the resulting evidence requires careful reasoning. That is a question about the strength of causal inference, not a test of whether the investigation qualifies as scientific research.
06 · What This Means for You
Choose a Design Because It Fits the Question, Not Because It Looks More Scientific
If you are planning a study, begin with the question and the inference you need to make. Do not begin with the assumption that you must manipulate something for the work to qualify as science.
Ask whether experimental assignment is relevant, feasible, and ethical. If your objective is to estimate the effect of an intervention and experimental assignment is appropriate, an experimental design may offer important advantages. If your phenomenon occurs naturally, cannot be manipulated, should not ethically be assigned, or does not require manipulation to answer the question, a nonexperimental approach may be more appropriate.
A simple decision framework
If you need to evaluate the effect of an intervention that can ethically and feasibly be assigned
Consider whether an experimental design provides the strongest appropriate test.
If the exposure or phenomenon occurs naturally and should not be assigned
Use an appropriate observational or other nonexperimental design and address its characteristic sources of uncertainty.
If your question is primarily descriptive
Do not add manipulation merely to make the study appear more scientific.
If experimental and nonexperimental approaches can address different parts of the problem
Consider how evidence from complementary designs may produce a more defensible understanding.
Methodological fit matters more than methodological prestige. This principle also explains why research may remain rigorous without following the method most common in a field . The researcher still carries the burden of showing why the chosen design is appropriate and what conclusions it can support.
07 · A Quick Checklist
Before Deciding That Your Study Needs an Experiment
Before choosing an experimental or nonexperimental design, check:
What exact research question am I trying to answer?
Does answering that question actually require manipulating or assigning a condition?
Would experimental manipulation be ethically acceptable and practically feasible?
If I use observational evidence, have I identified the main sources of confounding, selection, measurement error, and alternative explanation relevant to my design?
Does my sampling, measurement, and analysis support the claims I intend to make?
Am I distinguishing association from causation rather than assuming one establishes the other?
Have I explained why the chosen design is appropriate instead of apologizing for it simply because it is nonexperimental?
Are my conclusions appropriately bounded by the strengths and limitations of the design?
11 · Cite this Guide
How to Cite This Guide
This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.
Recommended (Field Guide)
APA
MLA
Chicago
Copy Citation