Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Should You Collect the Same Information From More Than One Source?

Collecting the same or related information from several sources can reveal agreement, disagreement, and different perspectives, but more sources do not automatically produce stronger evidence. Each source needs a clear evidentiary purpose.

70
Collecting Data From Multiple Sources Guide 70 of 217
01 · The Question

Is one source of evidence enough, or should you ask someone else too?

You want to study student engagement. Should you ask only students, or also their teachers? If you are investigating implementation of a university policy, should you rely on staff interviews, or also examine official documents and administrative records? If parents report children's behavior, should teachers provide another account?

Collecting information from more than one source can be valuable. Different sources may corroborate one another, reveal different perspectives, compensate for some limitations, or expose discrepancies that would otherwise remain invisible.

But adding sources is not automatically an improvement. The important question is what another source would contribute to the evidence and whether the sources are actually capable of informing the same claim.

02 · The Short Answer

Use multiple sources when each source has a defensible evidentiary role

In Brief

Collect the same or related information from more than one source when different sources can meaningfully corroborate, complement, contextualize, or challenge the evidence needed to answer your research question.

Do not add sources simply because more evidence sounds stronger. Sources may observe different settings, use different frames of reference, or possess different information, so disagreement can be expected and meaningful rather than evidence that one source must be wrong.

03 · What You Need to Know

Another source is useful only if you know what it adds

First distinguish a data source from a data collection method

A data source is the person, record, document, system, setting, artifact, or other origin from which evidence is obtained. A data collection method is the procedure used to obtain or record that evidence.

You can therefore use the same method with multiple sources. For example, you might interview students, teachers, and administrators. Conversely, you can use several methods with the same source or participant group, such as asking students to complete a questionnaire and participate in interviews.

Multiple sources Evidence comes from different people, records, systems, documents, settings, times, or other origins.
Multiple methods Evidence is obtained using different collection procedures, such as interviews, observations, questionnaires, or record extraction.

Keeping these decisions separate is important because they support different methodological rationales. The distinction also matters when considering data triangulation versus methodological triangulation.

Multiple sources can provide different perspectives on the same phenomenon

Some phenomena are experienced differently depending on a person's role or position. If you are studying implementation of a new educational policy, administrators may know how the policy was designed, faculty members may know how it affected teaching decisions, and students may know how implementation appeared in their learning experiences.

These are not necessarily interchangeable accounts of one objective reality. They may be different perspectives on a phenomenon that is itself distributed across roles and settings.

Collecting several perspectives can therefore broaden the evidence. The researcher should specify whether the intention is to compare perspectives, construct a more comprehensive account, identify common patterns, or understand why accounts differ.

Multiple sources can help distinguish formal policy from actual practice

Organizations offer a particularly clear example of why source choice matters. An official document can tell you what a policy states. An administrator can explain its intended purpose. A faculty member can describe how it is interpreted. Observation or records may provide evidence about what happens during implementation.

None of these sources necessarily answers the same question. Asking faculty members what the official policy says is not equivalent to examining the policy itself. Likewise, reading the policy cannot establish how consistently it is implemented.

The appropriate source should therefore follow the particular evidence required by the research question.

Multiple sources can sometimes corroborate evidence

Researchers may deliberately obtain evidence about a phenomenon from more than one source to examine whether findings converge. A student might report receiving frequent instructor feedback, for example, while course records document when feedback was actually released.

Agreement can increase confidence in some interpretations when the sources provide sufficiently independent and appropriate evidence of the same target. Yet agreement is not automatic proof. Two sources can share the same blind spot, depend on the same underlying record, or measure related but non-identical phenomena.

Before interpreting convergence, ask whether the sources are genuinely independent and whether they actually represent the same construct, behavior, event, population, and time period.

Different sources may observe different parts of the phenomenon

Suppose parents and teachers both rate a child's behavior. Their ratings may differ because the child behaves differently at home and at school. The sources may also use different expectations, observe the child at different times, or have unequal opportunities to witness particular behaviors.

In such a case, disagreement does not necessarily mean one informant is inaccurate. Each may be reporting valid information about behavior in a different context.

The same issue arises in organizational research. Senior leaders, frontline employees, and service users occupy different positions. Their accounts may diverge because the phenomenon itself looks different from those positions.

Disagreement between sources can be a finding

Researchers sometimes collect several sources expecting them to confirm one another and become uncomfortable when they do not. Yet discordance can be analytically valuable.

Suppose university administrators report that a new AI policy has been clearly communicated, while faculty members describe considerable uncertainty about acceptable practice. The discrepancy may reveal an implementation or communication problem. Averaging the two perspectives into a single conclusion would obscure precisely what the multiple-source design made visible.

Researchers should therefore plan in advance for convergence, complementarity, and disagreement. If sources conflict, examine possible differences in perspective, context, timing, measurement, access to information, and source-specific limitations before deciding how the discrepancy should be interpreted.

The same question asked of different people may not measure the same thing

It is tempting to use identical questionnaire items across several informants and assume that responses are directly comparable. Sometimes they are. Sometimes the same wording changes meaning depending on who answers.

Consider the statement “The instructor provides timely feedback.” A student may answer based on feedback received personally. An instructor may answer based on intended turnaround practices. A department chair may answer based on policy expectations or aggregate observations. Although the sentence looks identical, the evidentiary basis behind each response differs.

Researchers should therefore define whose knowledge or perspective is relevant rather than assuming that matching item wording guarantees equivalent evidence.

Several sources can still depend on the same underlying evidence

Apparent source diversity can be misleading. Suppose students and instructors both report grades by consulting the same learning-management system. Those reports are not fully independent confirmations of the grade because both ultimately depend on one underlying record.

Likewise, three institutional reports may all derive their statistics from the same administrative database. Counting them as three independent sources would exaggerate the diversity of the evidence.

When corroboration is the goal, trace where each source obtained its information. Source independence matters.

Multiple sources do not necessarily require multiple methods

You might conduct interviews with several stakeholder groups using related interview guides. That gives you multiple data sources while retaining one broad collection method.

Alternatively, you might interview participants and examine documents. Now both the sources and methods differ. If you observe practice as well, another collection method and source of evidence may be introduced.

This is why using more than one data collection method should be treated as a separate design decision from collecting information from multiple sources.

Multiple sources can increase burden and complexity

Every additional source has a cost. Recruiting another participant group may require separate permissions and consent procedures. Linking records can introduce privacy concerns. Collecting information from teachers, students, parents, and administrators may create substantially more data than the study can analyze coherently.

Source selection should therefore be strategic. If one source already provides adequate evidence for a narrowly defined question, another source may add little. If a second source addresses a genuine limitation, perspective, or evidentiary gap, the additional work may be justified.

This is part of the broader balance between methodological ambition and participant burden and practical constraints.

Collecting multiple sources can support triangulation, but the purpose matters

Data triangulation broadly involves examining a phenomenon using data obtained across different sources, people, settings, times, or other relevant dimensions, although terminology varies across methodological traditions.

The purpose should be explicit. You might examine whether evidence converges, seek complementary perspectives, identify context-specific differences, or develop a more comprehensive account. Simply adding another source and calling the study triangulated does not explain what the triangulation contributes.

The broader methodological question of what triangulation is actually supposed to accomplish therefore goes beyond the number of sources in the study.

04 · A Practical Example

When disagreement across sources tells you more than agreement would

Hypothetical Example

Evaluating implementation of a university feedback policy

A university introduces a policy requiring instructors to return assessment feedback within a specified period. Researchers want to understand how the policy is being implemented.

Source 1: Official policy The document establishes the formal requirement. It tells researchers what the institution says should happen.
Source 2: Faculty interviews Instructors describe how they interpret the requirement, the practical difficulties they encounter, and circumstances in which they believe exceptions are necessary.
Source 3: Student accounts Students describe when they perceive feedback as arriving and whether it is received in time to inform subsequent work.
Source 4: Administrative or platform records Where appropriately recorded and accessible, timestamps provide evidence about when selected assessments were submitted and when feedback was released.
Interpretation The sources may converge, but they need not. If faculty believe feedback is generally timely while records show substantial variation and students describe feedback as arriving too late to use, that disagreement becomes part of the implementation finding rather than a nuisance to be averaged away.

The value of multiple sources in this example comes from their different evidentiary positions. No single source can establish the formal rule, its interpretation, its recorded implementation, and the student's experience equally well.

05 · What Researchers Often Get Wrong

Common misconceptions about collecting evidence from multiple sources

Misconception

“More sources automatically mean stronger evidence”

No. Additional sources strengthen a study only when they provide relevant, sufficiently credible evidence and serve a clear methodological purpose. Several poorly aligned sources can add complexity without improving the answer.

Misconception

“The sources should agree if the data are valid”

Not necessarily. Sources may observe different contexts, possess different information, use different frames of reference, or experience the phenomenon differently. Disagreement can therefore be substantively meaningful.

Misconception

“If two people answer the same question, their answers measure the same thing”

Not automatically. Identical wording can draw on different knowledge and perspectives depending on who responds. Define what each source is actually positioned to know.

Misconception

“Several reports count as several independent sources”

Only if their underlying evidence is genuinely independent enough for the intended inference. Several reports may all reproduce information from the same database, survey, or administrative process.

Misconception

“Multiple sources automatically mean triangulation”

Multiple sources may form part of data triangulation, but the researcher should explain what is being compared, why those sources were selected, and what convergence, complementarity, or disagreement would mean. The label alone supplies none of that reasoning.

Misconception

“If sources disagree, I should choose the most objective one”

That can erase meaningful differences. First determine whether the sources were actually measuring the same phenomenon and whether the discrepancy reflects context, perspective, timing, measurement, or access to information. Different sources may each be valid for different aspects of the question.

06 · What This Means for You

Add another source only when you can explain what it contributes

For every additional source you are considering, complete the sentence: “I need this source because...” If the only answer is “to make the study stronger,” the rationale is not yet specific enough.

A simple decision framework

If one source has direct access to the evidence your question requires
Do not assume another source is necessary merely for methodological appearance.
If different stakeholders possess genuinely different perspectives or information
Consider multiple sources and plan how those perspectives will be compared or related.
If one source has an important limitation that another source can address
Consider collecting complementary evidence and specify what the second source contributes.
If corroboration is your purpose
Check that the sources provide sufficiently comparable and independent evidence before interpreting agreement as confirmation.
If sources may reasonably disagree
Plan how discrepancies will be examined rather than assuming one source will be declared correct.
If an additional source creates substantial burden but adds little evidentiary value
Prefer the simpler design.

Finally, resist the assumption that collecting more information is a methodological insurance policy. Whether additional sources improve the study depends on relevance, quality, independence, and purpose. The broader question of whether more sources or methods actually make evidence stronger requires examining those conditions explicitly.

07 · A Quick Checklist

Before collecting the same or related information from another source

For each additional source, check:
Specify what evidence the source can provide that is relevant to the research question.
Determine whether the source provides corroborating evidence, a different perspective, contextual information, or a genuinely different aspect of the phenomenon.
Check whether sources being compared actually refer to the same construct, behavior, event, setting, and time period.
Trace whether apparently different sources ultimately depend on the same underlying data.
Plan how you will interpret convergence, complementarity, and disagreement rather than expecting agreement by default.
Distinguish adding another data source from adding another data collection method.
Consider privacy, consent, permissions, linkage, recruitment, and participant burden created by each additional source.
Remove sources that do not make a clear contribution to answering the research question.
08 · Frequently Asked Questions

Frequently asked questions about collecting data from multiple sources

Why would I collect the same information from more than one source?

You might want to examine convergence, compare perspectives, address limitations of one source, understand contextual differences, or develop a more comprehensive account of the phenomenon. The purpose should be specified before data collection.

Do multiple sources make my findings more valid?

Not automatically. Multiple appropriate and sufficiently independent sources can strengthen some interpretations, but several sources can also share the same biases, rely on the same underlying information, or measure different phenomena. Source quantity is not a substitute for evidentiary quality.

What should I do when two data sources disagree?

First determine whether they actually measure the same phenomenon under comparable conditions. Then examine differences in context, timing, perspective, measurement, source knowledge, and potential error. The disagreement may be a substantive finding rather than a problem to eliminate.

Are multiple data sources the same as multiple data collection methods?

No. You can interview several stakeholder groups using one method, giving you multiple sources. You can also collect questionnaires and interviews from the same participants, giving you multiple methods involving the same participant source. The two design choices should be distinguished.

Does collecting data from multiple sources mean I am doing mixed methods?

No. Multiple sources can all provide qualitative evidence or all provide quantitative evidence. Mixed-methods research depends on substantive qualitative and quantitative components and their integration, not simply the number of sources.

Is collecting information from multiple sources triangulation?

It may constitute data triangulation when multiple data sources, participants, settings, times, or related dimensions are deliberately used to examine a phenomenon. The terminology varies, so researchers should state what sources are being used and what the comparison is intended to accomplish.

How many data sources should a study use?

There is no universal minimum or ideal number. Use as many sources as the research question and methodological rationale require, while considering feasibility, ethics, analytical capacity, and participant burden. One appropriate source can be enough for some questions.

09 · The Bottom Line

Another source should add evidence, not merely volume

The Bottom Line

Collect the same or related information from more than one source when the additional source can meaningfully corroborate, complement, contextualize, or challenge the evidence needed to answer your research question.

Do not expect multiple sources to agree automatically, and do not treat disagreement as failure. Determine what each source is positioned to know, whether the sources are genuinely comparable and independent, and what their convergence or divergence means. The value of multiple sources lies in what they contribute to the inference, not in how many columns they add to the methodology section.

10 · Sources and Further Reading

Sources and further reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes