03 · What You Need to Know
Choose a Different Method Because the Evidence Requires It
Start With What the Existing Methods Cannot Establish
A weak methodological rationale begins with the technique: “Previous studies used quantitative methods, so this study will use qualitative methods.”
A stronger rationale begins with the unanswered question.
Perhaps surveys consistently show that a behavior is common but reveal little about why people engage in it. Perhaps interviews identify plausible explanations but cannot estimate how prevalent those experiences are in the target population. Cross-sectional studies may establish an association without revealing temporal ordering. An experiment may estimate an intervention effect under controlled conditions without explaining how participants experienced the intervention or why implementation succeeded in one context and failed in another.
In each case, the alternative method becomes useful because it provides evidence relevant to something that remains unknown.
Methodological difference
The proposed study uses a research design, data source, measurement approach, or analytical strategy different from previous studies.
Methodological contribution
The different approach produces evidence needed to answer an important question or address a limitation that existing approaches cannot adequately resolve.
Only the second provides a strong research justification.
Different Methods Can Answer Different Types of Questions
Method choice should follow the research question rather than precede it.
A descriptive survey may estimate how common a behavior is. Qualitative interviews may investigate how participants understand that behavior and the circumstances surrounding it. Longitudinal observation can establish temporal patterns that a single cross-sectional measurement cannot. Experimental manipulation may provide stronger evidence about causal effects when its assumptions and implementation are appropriate.
These are not simply alternative ways of doing the same thing. They can address substantively different questions.
Consequently, a literature can contain many studies while still leaving an important question unanswered because nearly all of them approach the phenomenon through the same evidential window.
A Different Method Can Address a Shared Limitation in the Literature
Methodological concentration can create blind spots.
Suppose 30 studies examine the relationship between two variables using cross-sectional self-report surveys. The consistency of those studies may provide useful evidence that the variables covary under the conditions studied. Yet another similar survey may do little to clarify temporal ordering, behavioral mechanisms, measurement artifacts, or causal interpretation.
A different design could be informative if it addresses one of those unresolved limitations.
This is closely related to whether a better-controlled study can justify revisiting a well-studied question. The contribution does not arise from methodological variety for its own sake. It arises because the alternative design changes what can reasonably be inferred.
Qualitative Research Can Answer Questions That a Questionnaire May Leave Hidden
Suppose surveys consistently find that university students use generative AI for academic work. A larger survey could estimate prevalence more precisely, but it may still reveal little about how students decide when AI use is appropriate, how they negotiate uncertainty about institutional rules, or how they distinguish assistance from substitution of their own work.
Interviews, focus groups, observations, diaries, or other qualitative approaches may be more appropriate when the unresolved question concerns meaning, experience, process, interpretation, or context.
This does not make qualitative research a fallback for questions that quantitative research cannot answer. It reflects a different evidential purpose. The method should be selected because it fits the phenomenon and research question.
Quantitative Research Can Answer Questions That Qualitative Evidence Alone Cannot
The logic also works in the other direction.
Qualitative studies might identify several ways students experience an intervention and generate plausible explanations for why it succeeds or fails. If the next question is how common those patterns are across a defined population, whether variables are systematically associated, or whether an intervention produces an effect of a particular magnitude, an appropriately designed quantitative study may provide evidence the qualitative literature was not intended to produce.
Neither approach is inherently more rigorous. Rigour depends on whether the chosen method is appropriate for the question and implemented competently.
Cross-Sectional and Longitudinal Designs Do Not Answer the Same Temporal Questions
A cross-sectional study measures relevant variables at one point or over a limited observation period. It can identify patterns and associations, but it often provides weak evidence about temporal ordering.
If an important unresolved question concerns whether changes in one variable precede changes in another, repeated observations over time may provide a more appropriate design.
Longitudinal data do not automatically establish causation. Attrition, time-varying confounding, measurement problems, model specification, and other limitations can remain. Still, the design can provide temporal information that a single cross-sectional snapshot cannot.
The contribution should therefore be stated precisely: not “longitudinal research is better,” but “the existing cross-sectional evidence cannot address this temporal question adequately.”
Experiments Can Address Some Causal Questions That Observational Designs Cannot Resolve as Credibly
When researchers want to estimate the causal effect of an intervention, randomization can help address baseline confounding by assigning treatment independently of participant characteristics in expectation.
If an existing literature consists primarily of observational associations vulnerable to important confounding, an appropriately designed experiment may substantially improve the evidence.
That does not mean experiments answer every question or that observational research is inherently inferior. Some exposures cannot ethically or practically be randomized. Experiments can also suffer from nonadherence, attrition, measurement problems, implementation failure, limited applicability, and other threats.
The value of the method depends on the inference it enables relative to the alternatives.
Different Methods Can Test Whether a Finding Depends on a Particular Method
Sometimes the unresolved issue is methodological dependence itself.
If an effect appears only when measured through one instrument, one analytical strategy, or one type of data, researchers may reasonably ask whether the finding reflects the phenomenon or features of the method.
Triangulation provides one approach to this problem. Methodological triangulation combines evidence generated through approaches with different strengths and potential biases. When different methods point toward compatible conclusions despite differing weaknesses, confidence may increase. When they disagree, the discrepancy can reveal assumptions or features of the phenomenon requiring explanation.
Work on triangulation in epidemiology similarly emphasizes comparing approaches with different and ideally unrelated sources of bias rather than merely repeating variations of essentially the same method.
Agreement Across Methods Can Strengthen Evidence, but Disagreement Can Be Equally Informative
Researchers sometimes treat triangulation as successful only when every method produces the same answer. That is too simple.
Mixed-methods guidance distinguishes convergence, complementarity, and discrepancy when integrating findings. Different methods may agree, provide different pieces of a larger explanation, or appear to conflict. Explicitly examining disagreement can be analytically valuable rather than treating it automatically as methodological failure.
Suppose survey respondents report high confidence using a technology, while observations show frequent difficulty completing key tasks. The disagreement may reveal a distinction between perceived competence and demonstrated performance. Forcing both measures into one supposedly consistent conclusion would discard precisely the information that made multiple methods useful.
Mixed Methods Are Justified by Integration, Not by Having Two Kinds of Data
A mixed-methods study is not automatically stronger because it contains both numbers and interviews.
The methods should address related parts of an overarching question, and their integration should contribute something that neither component would provide independently. For example, quantitative data might identify a pattern while qualitative data help explain how that pattern arises. Qualitative findings might generate categories that are subsequently examined across a larger sample.
Simply conducting a survey and interviews side by side without a meaningful rationale for their relationship can increase workload without increasing understanding.
Watch Out
Do not add a second method merely to make a study appear more comprehensive. Multiple methods can multiply weaknesses as easily as strengths when each component is poorly matched to the question or when their findings are never meaningfully integrated.
A More Sophisticated Method Is Not Automatically a Better Method
Methodological novelty can be seductive. New analytical techniques, computational methods, machine-learning models, sensors, digital traces, and complex statistical approaches can make a project appear more advanced.
The relevant criterion remains whether the method improves the answer to the research question.
A sophisticated model fitted to weak measurements may not outperform a simpler analysis of better data. An elaborate qualitative coding framework cannot compensate for data that do not address the phenomenon. A new algorithm may optimize prediction while contributing little to a question about explanation.
Methodological complexity is therefore not a proxy for information gain.
A Different Method Can Reveal a Different Aspect Without Contradicting Existing Research
Not every methodological extension needs to challenge earlier findings.
Suppose experimental evidence establishes that an intervention improves performance. A qualitative study exploring participants' experiences may reveal why the intervention is difficult to use, which elements participants consider valuable, or what unintended consequences occur during implementation.
Those findings answer questions the experiment was not designed to answer. They can complement rather than compete with the existing evidence.
This is one reason methodological triangulation is often described in terms of complementarity rather than merely confirmation.
Method Choice Should Reflect the Evidential Gap, Not a Desire to Be Different
The strongest methodological extension can be summarized in a simple chain:
Existing evidence → unresolved question → evidence needed → method capable of producing that evidence.
If you reverse the sequence and begin with a preferred method, you risk manufacturing a research gap around the technique you already wanted to use.
This is also the broader test for whether another study adds information rather than merely another publication. The method matters because of the information it makes possible.
