Can a Design Be Common in Your Field but Still Wrong for Your Question?

Can a Widely Accepted Research Design Still Be Inappropriate for Your Study?

You are planning a study and notice that most published research in your field uses a particular design. Perhaps cross-sectional surveys dominate educational technology research in your area, experimental comparisons are common in intervention studies, or interviews are routinely used to investigate professional experiences.

Following that convention may seem sensible. The design is familiar to supervisors, recognizable to reviewers, and supported by numerous published examples. But does its popularity establish that it can answer your particular research question?

A design can be widely accepted within a discipline while remaining poorly suited to a specific inquiry. The difficulty is recognizing when established methodological practice provides a sound precedent and when it encourages researchers to reproduce limitations that their own questions require them to overcome.

Disciplinary Acceptance Does Not Guarantee Methodological Fit

Why Common Research Designs Are Not Always Appropriate

Methodological Popularity and Methodological Appropriateness Are Different

Research disciplines develop recognizable methodological traditions. These traditions reflect the questions scholars commonly investigate, the kinds of evidence they consider informative, and the practical conditions under which research is conducted.

Educational researchers, for example, may use surveys to investigate attitudes, perceptions, and reported practices. Experimental and quasi-experimental approaches are frequently relevant when evaluating instructional interventions. Qualitative approaches can help researchers understand experiences, classroom practices, and institutional processes.

These are legitimate methodological options. Their established use does not mean that they can be substituted for one another without changing what the study can establish.

A convention may be supported by substantial methodological experience. It may also persist partly because of available instruments, established training, familiar analytical procedures, or the kinds of studies that journals routinely publish.

None of these factors independently demonstrates that a design is suitable for a new question.

The relevant standard remains whether the research design is appropriate for the question being asked.

Why Do Certain Designs Become Common in a Discipline?

The prevalence of a design can reflect genuine methodological advantages. Some research problems repeatedly require similar evidence, making particular approaches efficient and well suited to established lines of inquiry.

For example, a cross-sectional survey can be useful when researchers need to estimate characteristics or examine associations at a defined time. A longitudinal design can be valuable when the question concerns change. Ethnographic approaches may be appropriate when understanding social practices requires sustained engagement with a setting.

Other influences are less directly connected to evidentiary requirements.

Researchers may favor designs for which instruments, datasets, software, and supervisory expertise are readily available. Funding arrangements, academic calendars, institutional access, and ethical constraints can also shape methodological choices.

Publication practices may reinforce these preferences. Researchers often encounter the designs most visible in the journals they read, although the published literature does not necessarily represent every approach that was attempted or could have been appropriate.

These influences help explain why methodological conventions develop. They do not establish that conventional designs are inherently weak or that unconventional designs are inherently better.

A Published Precedent Is Not the Same as a Design Justification

Researchers sometimes justify a methodological choice by citing previous studies that used the same design.

Such citations can demonstrate that an approach has been applied to related problems. They may also identify established instruments, procedures, or analytical considerations.

However, the statement that previous researchers used a cross-sectional survey does not explain why a cross-sectional survey can answer the present question.

Suppose earlier studies investigated associations between teachers' technological confidence and their reported use of digital learning tools. A new researcher wants to determine whether increasing technological confidence causes teachers to adopt those tools.

The earlier studies may provide relevant background, but their design does not automatically support the new causal objective. The researcher must consider temporal ordering, confounding, and a credible strategy for estimating the effect of interest.

A stronger justification would explain how the proposed design addresses those requirements and why alternative approaches were accepted or rejected.

Published precedent can support methodological reasoning. It should not replace that reasoning.

The Same Topic Can Require Different Research Designs

One reason researchers overgeneralize disciplinary conventions is that they classify studies primarily by topic rather than by question.

Consider research on generative AI in higher education.

These possibilities are illustrative rather than exclusive. Each question may admit more than one defensible design.

The important distinction is that shared subject matter does not create identical evidentiary requirements. A design common in studies of AI adoption may not be appropriate for estimating an AI intervention's causal effect.

When a Familiar Survey Cannot Answer an Explanatory Question

Surveys can support descriptive and analytical research. Depending on sampling, measurement, timing, and design, they can estimate prevalence, examine associations, and contribute to explanatory investigations.

However, a single cross-sectional survey generally offers limited evidence about temporal ordering when exposure and outcome are measured simultaneously.

Suppose researchers find that instructors reporting greater confidence in AI also report more frequent AI use.

The association might reflect confidence encouraging adoption. It could also reflect experience with AI increasing confidence. Other factors, such as institutional support or prior technological expertise, may influence both.

Applying regression or structural equation modeling does not automatically distinguish these explanations.

If the research question concerns association, the survey may be appropriate. If the question concerns a causal process, the researcher must evaluate whether the design and assumptions support that inference.

The issue is not whether surveys are acceptable within the discipline. It is whether the evidence collected can answer the particular question.

Disciplinary Conventions Can Influence Which Questions Researchers Ask

Methodological preferences may shape research questions before researchers consciously evaluate alternative approaches.

A researcher familiar with questionnaire-based studies may formulate questions about measurable perceptions or associations because those questions fit available instruments and analytical skills.

That is not necessarily inappropriate. Research questions can legitimately emerge from available methods and data.

The concern arises when a substantive problem requires a different kind of evidence but is reformulated merely to preserve the preferred design, without acknowledging what has been lost.

For example, a university may want to understand why an educational technology initiative failed. A survey of perceived usefulness could contribute relevant information, but it may overlook procurement decisions, infrastructure limitations, implementation processes, or institutional relationships.

If those conditions are central to the original problem, a design focused exclusively on individual perceptions may provide only a partial answer.

This is closely related to the possibility of a mismatch between the research design and the real research purpose.

When Should You Depart From an Established Methodological Tradition?

Departing from disciplinary convention may be justified when a different design offers a clearer evidentiary advantage for the question.

Such a departure should be based on methodological reasoning rather than novelty for its own sake.

A researcher might choose longitudinal measurement because existing cross-sectional studies cannot establish the developmental patterns of interest. Another might use qualitative observation because available surveys do not adequately capture the organizational processes being investigated.

In some cases, an alternative design may address an important limitation repeatedly acknowledged in previous research.

However, unfamiliar methods introduce their own obligations. Researchers must understand their assumptions, possess or obtain the necessary expertise, and ensure that the proposed procedures can be implemented competently.

Choosing an unconventional design without adequate justification is no more defensible than adopting a conventional design uncritically.

How Should You Evaluate Previous Studies Before Following Their Designs?

Rather than counting how many studies used a particular approach, examine what those studies were able to establish.

Start with their research questions. Determine whether they investigated the same type of inference as your proposed study.

Next, review their sampling strategies, measurements, timing, comparisons, and analytical assumptions. Pay particular attention to limitations that affect the conclusions you intend to make.

For example, a series of cross-sectional studies may provide consistent evidence of an association while leaving causal direction unresolved. Repeating the same design with a new sample may improve evidence about the association's consistency across settings, but it may contribute little to resolving causal direction.

Alternatively, replication may be exactly what the field needs if uncertainty concerns the stability or generalizability of an established finding.

The value of following a precedent depends on the remaining uncertainty and the contribution the new study is intended to make.

Disciplinary Standards Still Matter

Question-driven design selection does not mean disregarding disciplinary knowledge.

Research traditions provide accumulated experience about measurement, sampling, interpretation, ethical obligations, and threats to validity. Established reporting guidelines can also help researchers describe what they did transparently.

For example, the STROBE statement provides reporting recommendations for observational studies. Such guidance can improve reporting completeness, but compliance does not independently establish that an observational design was appropriate for the original question.

Similarly, qualitative reporting guidance can support transparency without determining which qualitative approach is most suitable for a particular inquiry.

The most defensible approach is to use disciplinary conventions as informed starting points while evaluating whether their assumptions and evidentiary capabilities fit the study.

Researchers should also distinguish methodological guidance from local preferences. A supervisor's favored approach, a department's customary format, or a journal's typical articles may influence practical decisions, but those preferences should not be presented as universal methodological requirements.

What If the Most Appropriate Design Is Unfamiliar to Your Field?

An unfamiliar design may require more explanation, particularly when readers are accustomed to different methodological traditions.

Researchers should clarify the question, identify the evidence required, and explain why the selected design offers advantages over familiar alternatives.

They should also acknowledge the design's limitations and demonstrate competence in its implementation.

Where necessary, collaboration, methodological consultation, or additional training may be appropriate.

Nevertheless, novelty should not become the primary justification. A conventional design remains preferable when it adequately answers the question and an alternative offers no meaningful improvement.

The decision should follow the same principle used when evaluating different designs capable of addressing the same research question: compare the evidence and limitations rather than relying on labels or popularity.

When Following Published Survey Studies Would Leave the Main Question Unanswered

The conventional survey approach was not inherently wrong. It was appropriate for the questions addressed by many earlier studies.

The mismatch emerged because the new study asked a different question. Following the same design without reconsidering its evidentiary capabilities would have preserved methodological familiarity at the expense of research purpose.

Misconceptions About Established Research Designs and Disciplinary Practice

How to Decide Whether to Follow or Depart From Disciplinary Convention

Use previous studies to understand the methodological options available, but do not allow their frequency to determine your choice.

Identify the question you are asking and the evidence needed to answer it. Then examine whether the designs used in related literature possess the necessary capabilities.

In a proposal or manuscript, explain the methodological reasoning directly. A defensible justification identifies what the design can establish, how it addresses relevant threats, and why it fits the research purpose.

It should not depend solely on statements that the design is commonly used or that previous researchers recommended it.

The broader objective is to avoid selecting a design before determining what evidence the question actually requires.

What to Check Before Following a Common Research Design

Frequently Asked Questions About Common Research Designs

Follow the Research Question, Not Simply the Disciplinary Convention

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.