Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Does Every Arrow in a Conceptual Framework Need Evidence?

An arrow in a conceptual framework is not merely a connector. When it represents a substantive relationship between concepts, the researcher should be able to justify that relationship, although justification does not always require prior studies proving it conclusively.

70
Evidence for Conceptual Framework Arrows Guide 70 of 223
01 · The Question

If You Draw an Arrow Between Two Concepts, What Justifies It?

Drawing an arrow in a conceptual framework takes seconds. Defending it may take considerably longer.

Suppose your framework shows that institutional support leads to AI self-efficacy, which then leads to instructors' adoption of generative AI. The boxes may be well supported individually. But what supports the arrows?

This question matters because an arrow can communicate a substantive proposition about the relationship between concepts. Depending on the framework, it might suggest association, influence, causal direction, sequence, mediation, feedback, or another form of connection.

So does every arrow require published evidence behind it? The answer depends partly on what the arrow claims.

02 · The Short Answer

Every Substantive Arrow Needs a Defensible Rationale, but Not Necessarily Conclusive Prior Evidence

In Brief

When an arrow represents a substantive relationship between concepts, you should be able to justify why that relationship is proposed, but this does not mean that previous research must already have conclusively demonstrated every relationship in your framework.

Support may come from theory, empirical findings, established conceptual reasoning, or a clearly argued combination of these. When evidence is limited or conflicting, say so rather than presenting a proposed relationship as established fact.

03 · What You Need to Know

An Arrow Is a Claim, and the Strength of the Claim Matters

First Determine What the Arrow Actually Means

Before asking how much evidence an arrow needs, determine what you are using it to communicate.

A line connecting two concepts might merely indicate that they are related. A one-directional arrow may imply that one concept predicts or influences another. In other frameworks, arrows can represent temporal sequence, information flow, pathways, or feedback.

These are not equivalent claims.

University research guidance on conceptual models, for example, distinguishes one-way arrows representing hypothesized directional relationships from two-headed connections representing unanalyzed correlations. More broadly, the meaning of graphical relationships depends on the conventions and explanation supplied by the researcher.

Before evaluating the evidence, therefore, make sure you can explain what each arrow in the conceptual framework actually means.

Evidence for the Concepts Does Not Automatically Support the Relationship

This distinction is fundamental.

Imagine that extensive literature establishes both AI literacy and responsible AI use as important research concepts. That evidence justifies taking each concept seriously. It does not automatically establish that greater AI literacy produces more responsible AI use.

The relationship is an additional proposition.

Evidence for a concept Supports the relevance, definition, or importance of the construct itself.
Evidence for an arrow Supports the proposition that two concepts are related in the particular way represented by the connection.

A common weakness in conceptual frameworks occurs when researchers cite literature beside the boxes but leave the relationships between those boxes unexplained.

Empirical Evidence Can Support a Proposed Relationship

Previous research may provide direct empirical support for an arrow.

Suppose several relevant studies report an association between perceived usefulness and intention to adopt a technology. Those findings can provide evidence for representing a relationship between the concepts in a new study.

But the wording and graphical representation should respect what the evidence establishes. A cross-sectional association, for example, does not by itself establish temporal order or causality. Evidence from another population or setting may also require qualification before being transferred to your own context.

This is one reason a framework built substantially from previous research still requires critical synthesis rather than mechanical reproduction of reported relationships.

Theory Can Justify a Relationship Even When Direct Empirical Evidence Is Limited

Sometimes a theory provides a mechanism explaining why one concept should relate to another, even though the precise relationship has received limited empirical investigation in your particular context.

That theoretical rationale can be meaningful evidence for proposing the arrow.

For example, an established theory might imply that a particular belief shapes behavioral intention. If you apply that proposition to a new technology or population, the theory may justify examining the directional relationship even before substantial context-specific evidence has accumulated.

The framework should make the status of the relationship clear: theoretically expected is not the same as empirically established.

A Proposed Relationship Can Be Worth Studying Precisely Because Evidence Is Incomplete

If every relationship in a framework had to be conclusively established beforehand, some research questions would become rather difficult to justify. Research often investigates relationships because knowledge about them is incomplete, contradictory, or context dependent.

An arrow can therefore represent a relationship that the researcher proposes to investigate rather than one the literature has already settled.

The critical requirement is intellectual transparency. Explain why the relationship is plausible and why examining it matters. Relevant theoretical reasoning, findings about related relationships, qualitative evidence, or an unresolved empirical pattern may collectively provide that rationale.

Watch Out

“Nobody has studied this relationship before” does not, by itself, justify an arrow. Novelty establishes that evidence may be missing; it does not establish that the proposed connection is conceptually plausible. Explain why the relationship is worth expecting or investigating.

Conflicting Evidence Does Not Necessarily Mean Removing the Arrow

Suppose some studies find that institutional support predicts technology adoption while others report weak or nonsignificant relationships.

Deleting the arrow and pretending the literature says nothing would discard useful information. Selecting only the supporting studies would be equally problematic.

Instead, represent the relationship if it remains conceptually relevant to your study and explain that previous evidence is mixed. The disagreement may itself motivate examining whether the relationship holds in your population or under your contextual conditions.

A conceptual framework can represent an expectation without claiming certainty.

Stronger Arrows Require Stronger Justification

The evidentiary burden should reflect the strength of the claim.

What the Arrow Suggests What Needs Justification Important Caution
Association Why the concepts are expected to vary together Do not automatically imply direction or causation.
Directional prediction Why one concept is expected to predict another in the stated direction Direction needs more reasoning than simple co-occurrence.
Causal influence A plausible mechanism plus evidence appropriate to a causal claim The framework alone does not establish causality.
Mediation Why one concept is expected to transmit part of the relationship between others A chain of correlations does not by itself establish a causal mechanism.
Moderation Why the strength or direction of one relationship should differ according to another concept The moderator has a specific relational role, not merely another direct effect.
Feedback or reciprocal relationship Why influence may plausibly operate in both directions The research design must be capable of addressing the reciprocal interpretation being proposed.

This is also why bidirectional relationships require careful thought. A second arrow is not merely a graphical flourish; it adds another substantive proposition.

Your Research Design Does Not Automatically Validate What the Arrow Implies

A framework can propose a relationship that a study intends to examine. Whether the study can actually test the full meaning of that relationship is a separate methodological question.

For example, a cross-sectional survey may test whether two variables are associated and whether one statistically predicts another. It usually provides a much weaker basis for establishing temporal or causal ordering than a design specifically capable of addressing those issues.

The Stanford conceptual-model guidance explicitly describes arrows as representing hypothesized relationships, an important distinction between the conceptual proposition and the evidence eventually produced by the study.

Your framework, research questions, hypotheses, measurements, and analytical strategy should therefore tell compatible stories.

Not Every Citation Has to Sit Beside the Arrow

Saying that an arrow needs justification does not mean turning the diagram into a bibliography.

The evidentiary argument can be developed in the surrounding text. You might introduce the concepts, synthesize theoretical and empirical evidence supporting their proposed relationship, acknowledge contradictory findings, and then explain how the framework represents that synthesis.

The diagram communicates the conceptual structure. The narrative provides the scholarly reasoning needed to defend it.

This distinction helps preserve readability while still making the framework auditable. The reader should be able to trace why the relationship exists even if the figure itself contains no citations.

04 · A Practical Example

How to Justify an Arrow Without Pretending the Relationship Is Proven

Hypothetical Example

AI self-efficacy → intention to use generative AI

Suppose a researcher proposes that university instructors with greater confidence in their ability to use generative AI will report stronger intentions to incorporate it into teaching.

Define the arrow The arrow represents an expected positive directional relationship. It does not mean the researcher has already demonstrated that increasing self-efficacy causes adoption.
Look for theoretical reasoning Relevant behavioral or technology-adoption literature may provide a mechanism explaining why confidence in one's ability to perform a behavior could influence willingness or intention to perform it.
Examine empirical findings The researcher reviews studies examining self-efficacy, confidence, behavioral intention, or closely related relationships in relevant educational and technological settings.
Evaluate transfer Evidence from other technologies or populations is considered useful but not assumed to apply perfectly to generative AI use among university instructors.
State the uncertainty If direct evidence in this specific context remains limited, the researcher describes the relationship as proposed or hypothesized rather than established.
Align the study The research question, measures, and analysis are designed to examine the relationship actually represented in the framework without claiming more than the design can support.

The arrow is therefore defensible even if the exact relationship has not already been proven in the target population. What matters is that the researcher can reconstruct the reasoning behind it.

05 · What Researchers Often Get Wrong

Common Mistakes When Justifying Relationships in a Framework

Misconception

If Both Concepts Have Citations, the Arrow Is Supported

Evidence establishing that two concepts are important does not necessarily establish a relationship between them. The connection is a separate proposition and needs its own rationale.

Misconception

You Need a Previous Study With Exactly the Same Arrow

Direct empirical precedent is valuable but not universally necessary. A relationship may also be justified through theory, related empirical findings, conceptual reasoning, or a combination of evidence, particularly when the study is addressing a genuine gap.

Misconception

An Arrow Automatically Means Causation

Arrow conventions vary, which is precisely why their meaning should be explained. If you intend an arrow to communicate causal influence, that is a stronger claim than association or prediction and requires correspondingly stronger justification.

Misconception

Only Significant Previous Findings Can Support an Arrow

Statistical significance alone is not an adequate evidence-selection criterion. Effect estimates, uncertainty, design quality, replication, theoretical coherence, measurement, and context all matter. Mixed findings may provide a reason to investigate the relationship further.

Misconception

The Diagram Can Speak for Itself

A reader should not have to infer whether an arrow means correlation, prediction, influence, causation, or sequence. Explain the conceptual meaning of the important connections in the accompanying narrative.

06 · What This Means for You

Treat Every Arrow as Something You May Have to Defend

A useful test is simple: point to an arrow and ask, “Why do I believe these concepts are related in this particular way?”

If your only answer is that the diagram looked incomplete without the connection, the arrow needs more work.

A simple decision framework

If strong theoretical and empirical evidence supports the relationship
Represent it confidently while keeping the claim consistent with what that evidence actually establishes.
If theory predicts the relationship but direct empirical evidence is limited
Present it as theoretically expected and explain that the study examines whether the relationship holds in the present context.
If empirical findings are mixed
Represent the relationship when it remains conceptually relevant, but disclose the uncertainty rather than presenting consensus.
If evidence exists only for association
Avoid using language or graphical conventions that imply an established causal effect unless additional justification exists.
If you cannot articulate any plausible basis for the relationship
Reconsider the arrow or develop a defensible rationale before retaining it.

This discipline becomes increasingly important as frameworks grow. Every additional connection increases what the framework claims. A dense network of arrows may look sophisticated while actually making the framework too complicated to remain analytically useful.

07 · A Quick Checklist

Can You Defend Every Relationship You Draw?

For every substantive arrow in your framework, check:
Can I state precisely what this arrow represents?
Can I explain why these concepts are expected to be related?
Have I examined relevant theoretical reasoning for the proposed relationship?
Have I reviewed relevant empirical findings, including contradictory or null results?
Does the direction of the arrow claim more than the existing evidence supports?
If evidence is limited, have I presented the relationship as proposed rather than established?
Is the relationship relevant to something the study actually intends to understand or examine?
Can my research design and analysis address the relationship without making unsupported causal or temporal claims?
08 · Frequently Asked Questions

Questions About Evidence for Conceptual Framework Arrows

Does every arrow need its own citation?

Not necessarily inside the diagram or immediately beside the arrow. What matters is that the substantive relationship has a traceable justification in the accompanying scholarly argument. Several relationships may sometimes be supported by the same theoretical or empirical literature.

Can I include an arrow if no previous study has tested the exact relationship?

Potentially. A novel relationship may be worth investigating when theory, related evidence, or a strong conceptual argument makes it plausible. Clearly distinguish a proposed relationship from one already established empirically.

Can theory alone justify an arrow?

In some studies, a well-established theoretical proposition may provide sufficient reason to hypothesize a relationship, particularly when the purpose is to test that proposition in a new setting. Relevant empirical evidence should still be examined when it exists.

What if previous studies disagree about the relationship?

Report the disagreement rather than hiding it. Mixed findings may justify examining whether the relationship operates differently in your population, context, or research design.

Does a one-way arrow mean causation?

Not universally. Diagram conventions differ. A one-way arrow may represent a hypothesized directional relationship, prediction, influence, sequence, or causal proposition depending on the framework. Define its meaning and avoid stronger causal language than your evidence and design support.

Can qualitative evidence justify a relationship?

Yes, depending on the claim. Qualitative evidence can illuminate mechanisms, processes, meanings, sequences, and perceived relationships. It should not be represented as though it provides statistical or causal evidence that the original study design did not establish.

What if my results later show that the relationship does not exist?

That does not retroactively make the original framework illegitimate if the relationship was reasonably justified as a proposition to be examined. The findings may instead require you to revise, qualify, or reject part of the framework rather than forcing the evidence to fit the original expectation.

09 · The Bottom Line

An Arrow Needs a Reason, Not a Predetermined Result

The Bottom Line

Every substantive arrow in a conceptual framework should have a defensible rationale, but you do not need previous research to have conclusively proven every relationship before you are allowed to investigate it.

Use theory, empirical findings, and careful conceptual reasoning to justify the relationship at the level you actually claim. When the evidence is incomplete or conflicting, make that uncertainty explicit. The purpose of research is sometimes to find out whether an arrow deserves to remain there.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes