03 · What You Need to Know
A Good Literature Matrix Is Designed Backward From the Questions You Want to Ask of the Literature
A literature matrix is often introduced as a table for organizing papers. That description is correct but incomplete. The University of Sheffield recommends selecting matrix columns according to the aims of the literature review and notes that researchers can add or remove columns depending on the information they want to collect. Its guidance also connects the matrix with identifying themes that emerge during reading.
The implication is important: you should not begin by asking, What information could I extract from every paper? Begin by asking, What will I eventually need to compare across these papers?
Step 1: Decide What the Matrix Needs to Help You Understand
Before creating columns, return to your research or review question. What distinctions might matter when you interpret the literature?
Suppose your review examines whether a particular educational technology improves student learning. You might eventually need to compare:
- which learners were studied;
- what technologies or interventions were actually used;
- what those interventions were compared with;
- how learning was measured;
- how long the intervention lasted;
- what research designs were used;
- what outcomes were reported; and
- under what conditions the findings differed.
If those distinctions could change your interpretation of the evidence, they are candidates for the matrix. If a piece of information is merely available but unlikely to affect your synthesis, it may not deserve its own column.
Step 2: Keep Source Identification Simple
Every row needs enough information to tell you which source it represents. Author and year may be sufficient for the visible identifier if the matrix is connected to a reliable reference-management system. You might also include a short title, citation key, DOI, or another identifier when useful.
A matrix should not become a second reference manager unless you have a particular reason to duplicate bibliographic metadata. The goal is to preserve traceability while reserving most of the matrix for analytical information.
Step 3: Create a Small Core of Study-Level Fields
For empirical literature, a useful starting structure might include:
| Field |
Question It Helps Answer |
| Source |
Which paper is this? |
| Purpose / Research Question |
What was the study actually investigating? |
| Context / Population |
Where and with whom was the evidence produced? |
| Method / Design |
How was the question investigated? |
| Relevant Finding |
What evidence bears directly on my review question? |
| Limitations / Qualifications |
What constrains how I should interpret or use the finding? |
| Relevance |
Why does this source matter to my review? |
This is only a starting point. The appropriate fields depend on the literature. A theoretical review might replace sample and method with constructs, assumptions, propositions, or theoretical relationships. A methodological review may require much finer distinctions among designs, instruments, analytical techniques, or validation procedures.
The broader principle is the same as when deciding what information to record from individual papers: capture information because you expect to use it.
Step 4: Add Fields That Explain Differences, Not Just Fields That Describe Studies
This is where a matrix begins to become analytical.
Imagine that several studies report different conclusions. A descriptive matrix might tell you that Study A found a positive effect while Study B found no effect. An analytical matrix should help you investigate why those results might differ.
You might therefore add fields such as:
- comparison condition;
- duration;
- measurement approach;
- implementation characteristics;
- geographic or institutional context;
- theoretical framework;
- important moderator or contextual variable; or
- another characteristic suggested by your particular literature.
Stanford's synthesis-matrix guidance explicitly encourages comparison not only by topics and themes but also by points of divergence such as method, academic discipline, geography, or time. Those differences can become analytically important because apparently contradictory findings may be answering somewhat different questions.
Step 5: Keep Cell Entries Concise Enough to Compare
A common matrix failure begins innocently: you paste an abstract into one cell. Then several paragraphs of methods go into another. Before long, every row contains a small article.
That preserves information but weakens comparability.
Use concise entries that capture the distinction you need. Instead of:
The researchers recruited undergraduate students enrolled in three sections of an introductory course at a large university and assigned...
you may need only:
Undergraduates; introductory course; one university; n = [sample size]
The correct amount of detail depends on the review. What matters is that you can scan down a column and recognize similarities and differences without rereading a paragraph in every cell.
Step 6: Preserve Qualifications Inside the Finding
Compression creates a risk: a nuanced result can become an overconfident label.
A cell containing only positive effect may conceal that the effect occurred for one outcome but not another, appeared only after controlling for a particular variable, or was observed in one subgroup.
Concise does not mean stripped of meaning. Record the qualification when it changes the interpretation.
Too compressed
Positive effect.
More analytically useful
Higher post-test performance for the intervention group; no clear difference in retention at follow-up.
Step 7: Add Themes After You Have Evidence for Them
You may begin with provisional themes derived from your research question, theoretical framework, or prior reading. But do not force every source into categories decided before you understand the literature.
As you read, recurring concepts and relationships may emerge. Add, merge, split, rename, or retire thematic categories when the evidence warrants it.
The University of Sheffield describes the matrix as a tool that can help researchers identify key themes emerging from their reading. This suggests an iterative relationship: the matrix organizes what you know, while what you learn from the literature changes the matrix.
Step 8: Allow One Paper to Contribute to More Than One Theme
A paper is not a filing card that must live in one conceptual drawer. A single study might contribute evidence about effectiveness, implementation, student perceptions, equity, and assessment simultaneously.
Your matrix should therefore permit multiple thematic connections. Depending on your software, you might use separate theme columns, multiple tags, binary indicators, or short notes within thematic cells.
If a source genuinely informs several parts of the review, there is no analytical benefit in forcing it into one category. A more flexible approach to organizing papers that fit multiple themes preserves those relationships.
Step 9: Add Relationship Fields, Not Just Content Fields
A matrix becomes much more useful when it records not only what a paper says but how it relates to the argument taking shape across the literature.
You might include a field such as:
Relationship to emerging argument
Possible entries could include:
- supports the emerging pattern;
- contradicts earlier evidence;
- qualifies the claim under a different condition;
- extends the finding to another population;
- uses a different operational definition;
- provides a methodological explanation for disagreement; or
- raises an unresolved question.
This does not mean reducing studies to simplistic labels. The point is to make relationships explicit so you can later track how sources support, contradict, or complicate an argument.
Step 10: Create Space for Cross-Source Synthesis
Study-level fields are useful, but they can still leave you reading one row at a time. At some point, you need to move across papers.
A synthesis-oriented matrix may place themes on one axis and sources on the other. Stanford describes this approach as relating different sources according to themes, topics, keywords, or codes so that researchers can contrast sources and synthesize points of agreement, disagreement, and divergence.
The University of Sheffield similarly recommends a synthesis matrix organized by theme and includes a synthesis column where the researcher can comment on multiple sources considered together. That final element is particularly valuable because it creates an explicit place for your interpretation rather than merely another location for source summaries.
| Theme |
Study A |
Study B |
Study C |
Cross-Source Synthesis |
| Learning outcome |
Improvement reported |
No clear difference |
Improvement under one condition |
Evidence varies according to condition and outcome measure; findings should not be treated as uniformly positive or negative. |
| Student perception |
Generally positive |
Mixed |
Not examined |
Acceptability appears variable and is not consistently measured across studies. |
| Instructor involvement |
Minimal |
Moderate |
AI plus instructor |
Human involvement differs enough that the studies may represent different intervention models. |
The final column is where the matrix begins to sound less like the papers and more like you. It records what becomes visible when the studies are considered together.
Step 11: Keep Source-Derived Information Separate From Your Interpretation
Analytical matrices inevitably contain both extracted evidence and your own judgments. That is useful, but only when you can distinguish them.
If a paper states that a limitation was its short intervention period, that is an author-reported limitation. If you notice that the outcome measure poorly represents the construct being discussed, that may be your methodological assessment.
Use separate columns, labels, or another consistent notation to keep the authors' claims distinct from your interpretation. Otherwise, the matrix can gradually erase the provenance of its own contents.
Step 12: Keep the Matrix Traceable to the Original Sources
Compression should never make verification impossible.
For important findings, definitions, quotations, methodological details, or claims you expect to cite, preserve page numbers or another appropriate locator. Keep the matrix connected to your reference manager, detailed notes, or PDFs through a citation key, DOI, link, or other stable identifier.
The matrix should make it easier to return to the source, not tempt you to cite from memory or from a compressed cell whose original context you can no longer reconstruct.
04 · A Practical Example
From a Storage Matrix to a Thinking Matrix
Hypothetical Example
Reviewing Studies of AI-Generated Feedback in Higher Education
Suppose you are reviewing hypothetical studies of AI-generated feedback for student writing. Your first matrix contains Author, Year, Title, Purpose, Method, Sample, Findings, and Limitations. It is organized, but after filling twenty rows you still struggle to explain why the findings differ.
The problem may not be insufficient information. The matrix may be preserving studies without exposing the distinctions needed for synthesis.
Start with the review question You are interested not merely in whether AI feedback produces positive outcomes, but in when, for whom, and compared with what those outcomes occur.
Add analytically useful comparisons You add feedback type, human involvement, comparison condition, feedback timing, outcome measured, duration, and educational context.
Read across the studies You notice that several apparently positive studies compare AI feedback with no feedback, while studies comparing AI with instructor feedback produce more mixed findings.
Inspect another difference Studies reporting improved writing performance measure revision quality, while several studies reporting positive experiences measure satisfaction or perceived usefulness.
Record the emerging interpretation You note that "effectiveness" is being operationalized differently across the literature and that comparison conditions also vary substantially.
Return to the sources You verify the relevant methods and results in the original papers before developing the claim in your review.
The improved matrix has not magically resolved the literature. Instead, it has made an important analytical problem visible: studies that initially seemed directly comparable may actually be evaluating different outcomes against different alternatives.
That observation can now guide further reading, analysis, and eventually the structure of the literature review.