Pretest vs. Pilot Study vs. Feasibility Study: What’s the Difference?

Are a Pretest, Pilot Study, and Feasibility Study Just Different Names for the Same Thing?

You want to test something before beginning the main study. Should you call it a pretest, a pilot study, or a feasibility study?

The confusion is understandable because all three can occur before the main research and all can reveal problems while there is still time to correct them. Their purposes and scope, however, are not identical. A researcher checking whether participants understand questionnaire items is doing something different from a team testing whether an entire recruitment, intervention, and follow-up workflow can operate successfully.

The terminology is also not perfectly standardized across disciplines. “Pilot testing” is sometimes used informally for instrument pretesting, while methodological literature on pilot and feasibility studies may use more specific definitions. The safest approach is therefore to understand the underlying purposes and describe exactly what you tested.

The Difference Is Mainly What You Are Trying to Learn and How Much of the Study You Test

Three Ways of Testing Research Before the Main Study

A Pretest Usually Focuses on a Particular Component

Pretesting commonly refers to trying out a research instrument, question, instruction, task, or procedure before using it formally in the main study. The objective is usually focused: identify problems with that component and refine it.

For a questionnaire, researchers might examine whether respondents understand the wording, interpret questions as intended, can use the response options, encounter confusing instructions, or experience excessive burden. For an interview guide, pretesting might reveal questions that are ambiguous, repetitive, overly technical, or unlikely to elicit the information required.

A pretest does not necessarily attempt to reproduce the entire research workflow. If your only uncertainty concerns whether participants understand an instruction, testing recruitment, follow-up, data management, and every other procedure may add little.

This narrower scope is one reason focused pretesting can be more efficient than automatically conducting a full pilot.

Be Careful: “Pretest” Has More Than One Meaning in Research

The term pretest is context-dependent. In survey and instrument development, it commonly refers to testing an instrument before fielding it. In experimental and quasi-experimental designs, however, a pretest may refer to a measurement taken before an intervention or treatment, as in a pretest-posttest design.

These meanings should not be conflated. In the present comparison, “pretest” refers to preliminary testing of a study component, not simply a baseline measurement.

A Feasibility Study Asks Whether and How the Future Study Can Be Done

Feasibility is broader than instrument testing. A feasibility study investigates uncertainties that affect whether researchers can proceed with a proposed future study and, if so, how.

Relevant uncertainties may concern recruitment, retention, acceptability, intervention delivery, resources, staffing, randomization, measurement, follow-up, site participation, data collection, or other study processes.

Importantly, a feasibility study does not necessarily reproduce the future study. Researchers could use interviews to investigate whether potential participants would accept a proposed intervention, examine records to estimate the available eligible population, or consult participating sites to determine whether required procedures can be implemented.

The question what the feasibility study needs to tell you should determine the methods used.

A Pilot Tests the Future Study, or Part of It, in Practice

A pilot is a particular form of feasibility work. In the conceptual framework developed by Eldridge and colleagues for research conducted in preparation for randomized controlled trials, a pilot involves conducting the future study, or part of it, on a smaller scale.

For example, a team planning a randomized trial might pilot the sequence of identifying participants, checking eligibility, obtaining consent, collecting baseline measures, randomizing participants, delivering the intervention, and conducting follow-up.

The pilot is therefore especially useful when the uncertainty concerns how study components operate together. An instrument may work in isolation and a recruitment strategy may look plausible in isolation, yet the combined participant journey may be too burdensome or operationally difficult.

The pilot should have explicit objectives concerning the future study. Researchers should determine which procedures and processes genuinely need piloting rather than simply running the main protocol with fewer participants.

Pilot and Feasibility Are Not Necessarily Mutually Exclusive

A common diagram would place “pilot study” and “feasibility study” in separate boxes. That can be misleading.

In the framework developed by Eldridge and colleagues, feasibility is the overarching concept. A feasibility study asks whether something can be done, whether researchers should proceed, and how. A pilot asks those same questions but does so by conducting the future study or part of it on a smaller scale.

Under that framework, all pilot studies are feasibility studies, but not all feasibility studies are pilots.

This relationship is particularly well developed in methodological guidance for research preparing for randomized trials. Terminology in other disciplines can differ, so researchers should explain their usage rather than assuming that every reader will apply the same taxonomy.

Pretesting Can Be Part of Broader Feasibility or Pilot Work

The categories are also not necessarily sequential boxes through which every project must pass.

A pilot may contain a focused test of instructions or questionnaires. A broader feasibility program may include instrument pretesting alongside interviews, recruitment assessments, and eventually a pilot. Alternatively, a simple study may need only a focused pretest and no formal pilot at all.

The appropriate amount of preliminary work depends on uncertainty. This is why asking whether a pilot or feasibility study is actually needed should come before choosing one merely because it sounds methodologically thorough.

The Difference Is Not Sample Size

You cannot reliably distinguish these approaches by counting participants.

A pretest could involve a small number of participants because the researcher is investigating how particular questions are understood. A feasibility study could require a larger sample if estimating a recruitment or retention parameter with useful precision is important. A pilot may also vary substantially in size depending on what processes it needs to test.

“We used 10% of the main sample, therefore this was a pilot” is not a general methodological rule. Sample size should follow the objectives of the preliminary work.

The Difference Is Not Simply Which One Comes First

It may seem logical to imagine a fixed progression from pretest to feasibility study to pilot to main study. Real research is often less tidy. Methodological development rarely respects a perfectly straight arrow, much to the disappointment of flowchart enthusiasts.

A researcher may pretest an instrument and then proceed directly to the main study because no other important uncertainty remains. Another project may conduct qualitative feasibility work, modify an intervention, pretest revised participant materials, conduct a pilot, and then reconsider part of the design again.

The order should follow what researchers need to learn, not an assumed universal sequence.

A Simple Comparison Helps Clarify the Boundaries

These distinctions are useful organizing principles, not universal labels enforced identically across every research tradition. Clear objectives and reporting remain more important than winning a terminological argument.

How the Three Approaches Could Appear in One Research Project

This sequence is plausible, but it is not mandatory. If the questionnaire were already well tested, the pretest might be unnecessary. If existing evidence established feasibility convincingly, the researchers might need less preliminary work. The design should follow the uncertainty rather than the example.

Common Mistakes When Distinguishing Pretests, Pilots, and Feasibility Studies

Choose the Smallest Preliminary Study That Answers the Important Question

Begin with the uncertainty, not the terminology. Ask what you do not yet know and what evidence would resolve it sufficiently to make the next research decision.

Whatever terminology you use, report enough detail for readers to understand the objectives, methods, findings, and implications for the future study. The label should summarize the design, not substitute for its explanation.

And if your real question is broader than terminology, identify which parts of the proposed study actually need testing before deciding how extensive the preliminary work should be.

Before Calling Your Preliminary Work a Pretest, Pilot, or Feasibility Study

Frequently Asked Questions About Pretests, Pilot Studies, and Feasibility Studies

Let the Uncertainty Determine the Preliminary Study

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.