Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Direct vs. Indirect Measures: When Can’t You Measure the Thing You Actually Care About?

Researchers often care about phenomena they cannot observe directly. Understanding direct and indirect measurement helps you distinguish what you actually observed from the construct you ultimately want to make claims about.

114
Direct vs. Indirect Measures Guide 114 of 217
01 · The Question

What If the Thing You Want to Study Cannot Be Observed Directly?

Some variables seem straightforward to measure. If you want a participant's height, you can use an appropriate measuring device. If you want the number of assignments submitted, you can count the relevant records.

But what if you want to study motivation, anxiety, trust, cognitive load, loneliness, engagement, or another construct that cannot simply be observed in the same way?

You may need to measure something observable and use it as evidence about the phenomenon you actually care about. That distinction is at the heart of direct and indirect measurement, and it affects how confidently you can interpret the resulting data.

02 · The Short Answer

Sometimes You Measure the Phenomenon; Sometimes You Measure Evidence About It

In Brief

A direct measure obtains information about the target attribute relatively directly, while an indirect measure relies on observable responses, behaviors, indicators, proxies, or consequences from which the target construct is inferred.

The boundary is not always absolute, and terminology varies across disciplines. More importantly, indirect does not mean inferior: many important constructs cannot be observed directly, so the critical issue is whether the chosen evidence supports the interpretation you want to make.

03 · What You Need to Know

Understand the Distance Between What You Observe and What You Want to Know

Direct Measurement Keeps the Observation Close to the Target Attribute

In a relatively direct measurement, the observation corresponds closely to the attribute being measured. If your research variable is body mass, an appropriately calibrated scale can provide a measurement of body mass. If the variable is the number of completed tasks recorded in a system, the relevant records can be counted according to a defined rule.

Even these examples involve measurement procedures, instruments, definitions, and possible error. “Direct” should therefore not be interpreted as “perfect” or “error-free.” It describes the relationship between the observation and the target attribute, not the quality of the measurement.

Indirect Measurement Requires an Inference

Many constructs are not directly observable. You cannot place motivation, anxiety, self-efficacy, or sense of belonging on a physical measuring device. Instead, researchers observe something that is expected to provide evidence about the construct.

For example, participants might respond to statements about their thoughts, feelings, or behavior. Those responses are observable. The underlying construct is inferred from the pattern or score produced by those observations.

This distinction becomes clearer when you separate the construct, indicators, and instrument. The questionnaire may be the instrument, the responses may serve as indicators, and the resulting score may be interpreted as evidence about a construct that cannot itself be directly observed.

More direct measurement The recorded observation corresponds relatively closely to the target attribute itself.
More indirect measurement The researcher observes an indicator, response, behavior, consequence, or proxy and uses it to make an inference about the target construct.

Direct and Indirect Are Often Better Understood as a Continuum

The distinction can become less tidy in real research. What counts as direct depends partly on how the target variable has been defined.

Suppose your variable is “number of LMS logins during a semester.” A properly extracted system log may measure that operational variable quite directly. If you instead call the variable “student engagement,” the same login count becomes an indirect indicator of a much broader construct.

The data have not changed. The inferential distance has.

This is why your conceptual and operational definitions matter. Whether an observation is relatively direct or highly indirect cannot always be determined without knowing precisely what you claim to be measuring.

A Proxy Is Not Automatically the Same as the Target Construct

A proxy measure uses one variable as a practical stand-in for another phenomenon that is unavailable, difficult, expensive, or impossible to measure more directly.

Researchers may sometimes use administrative records, geographic variables, behavioral traces, or other accessible data as proxies for harder-to-observe phenomena. Such choices can be useful, but the relationship between proxy and target needs justification.

For example, number of discussion posts might be used as evidence about online participation. That is a fairly close connection if participation has been operationalized specifically as posting behavior. Using the same number as a proxy for deep cognitive engagement requires a considerably stronger inferential step.

Watch Out

Do not quietly rename a proxy as the construct itself. If you observe attendance, clicks, purchases, grades, or another behavioral record, report what was actually observed and justify any broader interpretation you make from it.

Indirect Measures Can Be Highly Valuable

It would be a mistake to assume that direct measures are inherently scientifically superior. Some research questions concern constructs for which direct observation is conceptually impossible. Psychological traits, attitudes, beliefs, perceptions, and many social constructs are investigated through observable manifestations precisely because the constructs themselves are not directly accessible.

In these situations, the important issue is the quality of the inference. Does theory explain why the indicators should represent the construct? Does the instrument adequately cover the relevant content? Does empirical evidence support the intended interpretation of the resulting scores?

The Standards for Educational and Psychological Testing frames validity around evidence and theory supporting interpretations of test scores for proposed uses. That principle is particularly useful for indirect measurement because it directs attention away from whether a score simply exists and toward what the score can legitimately be interpreted to mean.

Indirect Measurement Can Introduce Construct-Irrelevant Influences

Suppose response time on a computer task is used as an indicator of a cognitive process. Response time might reflect that process, but it could also be affected by reading speed, motor ability, device latency, distraction, misunderstanding, or other influences.

Likewise, attendance may reflect engagement but also transportation problems, illness, employment obligations, course policies, or scheduling constraints. An indicator can therefore contain information about the target construct while simultaneously reflecting other factors.

This is one route through which measurement error can affect a study before analysis begins. Statistical sophistication later cannot automatically separate a poorly justified indicator from the other influences embedded in it.

Sometimes Several Forms of Evidence Are Better Than One

When no single observation adequately represents a construct, researchers may use multiple indicators, instruments, methods, or data sources. A study of engagement, for example, could combine appropriately validated self-report information with carefully defined behavioral evidence if both are relevant to the research question.

This does not mean that adding more measures automatically improves a study. Multiple weak proxies remain weak evidence. Different methods may also represent different aspects of the construct rather than interchangeable estimates of the same thing.

The broader point is that a construct may have several defensible forms of measurement, and their usefulness depends on the inference each supports.

The Measurement Choice Can Change the Question

Consider the difference between asking whether students are engaged and asking whether students log into a platform frequently. Those questions may be related, but they are not identical.

If the only available variable is login frequency, researchers can either justify it as an indicator of a particular aspect of engagement or narrow their claims to the behavior actually observed. What they should not do is assume that an accessible variable automatically inherits the full meaning of the theoretical construct.

This is why the way you operationalize something can eventually change the research question you are actually answering.

04 · A Practical Example

Can LMS Activity Directly Measure Student Engagement?

Hypothetical Example

The same data can be direct for one variable and indirect for another

Suppose a researcher extracts the number of times each student accesses an online course during a semester.

Recorded observation The system records 42 qualifying course accesses for one student during the defined observation period.
If the target variable is course-access frequency The system record provides relatively direct evidence of the operational variable, assuming the logging system and counting rules work as intended.
If the target construct is behavioral engagement Course-access frequency becomes an indicator whose adequacy depends on how behavioral engagement has been defined.
If the target construct is overall student engagement The same variable becomes an even more indirect representation because engagement may include cognitive, emotional, or other dimensions not revealed by access frequency.
Research implication The researcher should either provide evidence and theory supporting the broader inference or describe the finding more narrowly as a difference in recorded course-access behavior.

The example illustrates why “direct” and “indirect” cannot always be assigned to a data source in isolation. The relevant question is direct with respect to what? The closer your claim stays to what was actually observed, the smaller the inferential leap tends to be.

05 · What Researchers Often Get Wrong

Common Mistakes About Direct and Indirect Measurement

Misconception

Direct Measures Are Always More Valid

Directness and validity are not the same property. A direct measurement can be poorly calibrated, unreliable, badly defined, or inappropriate for the research question. An indirect measure can support strong inferences when its indicators and score interpretations are supported by appropriate evidence.

Misconception

Behavioral Data Are Automatically Direct Measures

A behavior may be observed directly while the construct inferred from it is not. Attendance can be directly recorded as attendance, for example, but becomes indirect when interpreted as motivation, belonging, engagement, or another broader construct.

Misconception

Self-Reports Are Always Indirect but Device Data Are Direct

The distinction depends on the target. A self-report may provide direct information about a person's reported perception, while a sensor can provide only indirect evidence about a psychological state. The data source alone does not determine directness.

Misconception

If a Proxy Correlates With the Construct, It Becomes Equivalent to It

Association does not establish equivalence. A proxy may covary with a construct while also reflecting other influences. Researchers need to justify the interpretation and acknowledge what the proxy may fail to capture.

Misconception

Indirect Measurement Is Something Researchers Should Avoid

For many theoretically important constructs, indirect measurement is unavoidable. The methodological task is not to eliminate inference but to make the inferential chain explicit and support it with appropriate theory and evidence.

06 · What This Means for You

Ask How Far Your Evidence Is From Your Claim

Instead of asking only whether a measure is direct or indirect, trace the relationship between what you observe and what you ultimately want to claim.

A simple decision framework

If the observation closely corresponds to the variable you actually want to describe
A relatively direct measurement may be sufficient, provided the procedure itself is appropriate and accurate.
If the target construct cannot be directly observed
Identify observable indicators and establish why they provide evidence about that construct.
If you are using a convenient proxy
Examine what else could influence the proxy and avoid interpreting it as though it were identical to the target construct.
If one indicator captures only a narrow manifestation
Consider additional evidence or narrow the construct and claim to match what is actually measured.
If the inferential leap is difficult to justify
Reconsider the operationalization before collecting data rather than relying on analysis to repair the mismatch later.

In your methods and discussion, name the observed variable precisely. Then explain the broader interpretation separately. This simple discipline makes it much harder to accidentally transform “frequency of recorded behavior” into “motivation” or “engagement” merely by changing the variable label.

07 · A Quick Checklist

Before Using an Indirect Measure, Check the Inferential Chain

Before interpreting your measurement, check:
Can you state precisely what was actually observed or recorded?
Can you distinguish that observation from the broader construct you want to infer?
Is there a theoretical reason the indicator should represent the target construct?
Have you considered alternative factors that could influence the indicator?
Does the measure capture the dimensions of the construct necessary for your research question?
If using an established instrument, have you examined evidence supporting the intended interpretation and use?
Are your conclusions no broader than the evidence produced by the measurement procedure can support?
08 · Frequently Asked Questions

Questions About Direct and Indirect Measures

What is a direct measure in research?

A direct measure obtains information that corresponds relatively closely to the target attribute being measured. The exact meaning varies by discipline, so directness is best considered in relation to a clearly defined target variable rather than treated as an absolute property of a data source.

What is an indirect measure?

An indirect measure uses observable responses, behaviors, indicators, consequences, proxies, or other evidence to support an inference about a target construct that is not observed directly.

Is a questionnaire a direct or indirect measure?

It depends on what you claim to measure. A questionnaire can directly record participants' responses and self-reports, but those responses may serve as indirect indicators of an underlying construct such as anxiety, motivation, or self-efficacy.

Are behavioral measures direct measures?

Not automatically. A behavior can be observed relatively directly, but using that behavior to represent an underlying construct introduces an inference. Directness therefore depends on the target of measurement.

Is a proxy the same as an indirect measure?

A proxy is a common form of indirect measurement in which an observable or available variable stands in for another phenomenon. Not every indirect measure is necessarily described as a proxy, particularly in measurement traditions where observable indicators are explicitly modeled as manifestations of latent constructs.

Should I avoid indirect measures when direct measures are available?

Not as a universal rule. The appropriate choice depends on the construct, research question, intended inference, measurement quality, feasibility, and context. A supposedly direct measure may answer a different question from the indirect measure you actually need.

09 · The Bottom Line

Measure What You Can Observe, but Be Precise About What You Infer

The Bottom Line

A direct measure keeps the observation relatively close to the target attribute, while an indirect measure uses observable evidence to support an inference about something that cannot or is not being measured directly.

Indirect measurement is neither unusual nor inherently weak. What matters is whether the connection between the observed evidence and the intended construct is theoretically and empirically defensible, and whether your conclusions remain within the limits of that evidence.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes