03 · What You Need to Know
Count the methodological components, not merely the instruments
A data collection method is not the same thing as a methodological approach
One source of confusion is the word “method.” It can refer to a broad methodological approach, an overall research design, a specific data collection technique, or an analytical procedure. As a result, saying that a study “uses multiple methods” can mean several different things.
An interview, observation, questionnaire, focus group, document analysis procedure, test, or system-log extraction can function as a data collection technique. Using two of these does not automatically mean that two methodological traditions have been combined.
For example, a qualitative case study might use interviews, observations, and documents to understand the same case. Multiple forms of data collection are common in case study research and other qualitative designs. The study can remain qualitative if its design, evidence, analysis, and inferential logic remain within that methodological orientation.
Similarly, a quantitative study might combine a standardized questionnaire, test scores, and administrative records. Three sources of quantitative evidence do not make the design mixed methods merely because three collection procedures are involved.
Mixed methods requires more than numerical and textual material appearing together
Widely used definitions of mixed-methods research emphasize the collection and analysis of both quantitative and qualitative data and their integration within an overall study. Integration can occur at several points, including design, methods, interpretation, and reporting.
This matters because superficial combinations can easily be mislabeled. An interview study does not become mixed methods merely because the researcher reports participants' ages numerically. A survey does not necessarily become mixed methods because it contains one optional comment box. Likewise, a qualitative study does not become mixed methods because researchers count how many participants mentioned a theme.
The broader distinction between having both numbers and words and actually conducting mixed-methods research depends on how those forms of evidence function within the study.
Integration is central to mixed-methods research
Mixed-methods scholars commonly treat integration as a defining feature rather than an optional final step. Integration means that the qualitative and quantitative components are deliberately related so that their combination contributes to answering the research problem.
Fetters, Curry, and Creswell describe integration at several levels. One dataset may help determine sampling for another; findings from one component may shape collection in another; qualitative and quantitative datasets may be merged for analysis; one component may be embedded within another; or findings may be explicitly brought together during interpretation and reporting.
Simply conducting a survey and several interviews in the same project therefore does not tell you enough. You still need to know what each component is doing and how they relate.
Multiple data collection methods
Two or more techniques or sources are used to obtain evidence. They may all belong to the same broad methodological approach.
Mixed-methods research
Qualitative and quantitative components are intentionally combined and integrated according to an overall methodological design.
A qualitative study can use several collection methods
Consider an ethnographic or case-oriented study of technology use in a university department. Researchers might observe meetings, interview faculty members, collect institutional documents, and examine artifacts produced during implementation.
Those techniques provide different forms of qualitative evidence. Observation may capture practices and interactions, interviews may reveal participants' interpretations, and documents may show formal policies or historical records. Their combination can deepen understanding without turning the study into mixed methods.
The methodological rationale may involve complementarity, contextualization, or triangulation. Methodological literature describes triangulation as the use of multiple methods, data sources, investigators, or theoretical perspectives to examine a phenomenon, although terminology and classifications vary across traditions.
A quantitative study can also use several collection methods
Imagine a study examining academic performance and technology use. Researchers administer a standardized scale, obtain assessment scores, and extract platform activity records. Each procedure generates quantitative variables that are analyzed within a quantitative design.
The study uses several collection methods or data sources, but nothing about that combination inherently introduces a qualitative component. It therefore does not become mixed methods simply because the evidence came through several routes.
This distinction is especially useful when planning which collection methods fit the evidence required by the research question. Researchers can choose several techniques because the question warrants them without prematurely assigning a mixed-methods label.
Multiple methods should have a methodological purpose
Adding a second method should answer a recognizable need. Perhaps observation captures behavior that interviews cannot. Documents provide historical or institutional context unavailable from participant accounts. Administrative records provide independently recorded outcomes. One method may also reveal a dimension of the phenomenon that another cannot adequately capture.
The rationale should be specified before simply assuming that more methods create stronger evidence. Multiple methods add collection time, analysis, data management, ethical considerations, and sometimes participant burden.
If you cannot explain what the second method contributes, that is a useful warning. Methodological ornamentation is still ornamentation, even when it produces another spreadsheet.
Using several methods is not automatically triangulation either
Triangulation is another term that is sometimes used too loosely. Simply having interviews and observations in the same project does not explain whether or how the researcher intends to relate the resulting evidence.
Classic and contemporary accounts distinguish several forms of triangulation, including data, investigator, theoretical, and methodological triangulation. Methodological triangulation concerns the use of more than one method to investigate a phenomenon, with further distinctions sometimes made between within-method and between-method forms.
Whether your particular combination should be described as triangulation depends on its purpose and methodological framing. If the methods address unrelated questions and their results are never meaningfully compared or connected, calling the arrangement triangulation may communicate more methodological integration than actually occurred.
The broader question of what triangulation is supposed to accomplish therefore deserves separate treatment from simply deciding to collect more data.
Multiple sources and multiple methods are also different decisions
You can collect data from several sources using one method, or use several methods with the same source or population. These design choices should not be collapsed.
For example, the same interview protocol might be used with students, instructors, and administrators. That introduces several participant groups or data sources without necessarily introducing several collection methods. Conversely, the same group of students might complete a questionnaire and participate in interviews, giving the researcher two collection methods involving one participant group.
Thinking separately about whether information should come from more than one source can make the design rationale much clearer.
Do not let the label determine the design
Researchers sometimes begin by deciding that a project should be “mixed methods” and then search for something quantitative and something qualitative to add. This reverses the more defensible sequence.
Begin with the research problem and questions. Determine what evidence is necessary. Decide which sources and collection procedures can provide it. Then determine the methodological design that accurately describes how those components will be analyzed and related.
If one qualitative approach with two collection techniques adequately answers the question, there is no methodological prize for relabeling it as mixed methods.
