01 · The Question
What If the Research Exists but Was Never Published as a Journal Article?
You search peer-reviewed journals and find very little on your topic. Perhaps there are only two empirical articles, neither of which answers your question completely. It seems reasonable to conclude that the evidence base is sparse.
Then you discover several doctoral dissertations, a government report, and conference proceedings addressing almost exactly the same problem.
Do those sources count?
They can. Research evidence is not confined to journal articles. Depending on the field and question, relevant work may appear in dissertations and theses, government or technical reports, conference abstracts or proceedings, working papers, institutional repositories, research registries, and other materials commonly grouped under the broad label grey literature .
If your gap claim concerns what is known rather than merely what has appeared in journals, ignoring those sources can make an existing body of work look absent.
03 · What You Need to Know
Why Searching Only Journal Articles Can Produce an Apparent Gap
Grey literature is broader than unpublished research
The term grey literature is generally used for material produced outside traditional commercial or academic publishing channels. The category is broad and its boundaries are not perfectly fixed.
Depending on the field, potentially relevant sources may include:
doctoral dissertations and master's theses;
government and intergovernmental reports;
technical and research reports;
conference abstracts and proceedings;
working papers;
institutional and organizational publications;
clinical trial or study registries;
policy documents and evaluation reports; and
other research outputs not disseminated through conventional journal publishing.
Some grey literature is formally published and publicly accessible. Some is difficult to locate. Some contains complete empirical studies, while other sources provide only preliminary or abbreviated information. Treating all grey literature as one homogeneous type of evidence is therefore unhelpful.
A journal gap is not automatically an evidence gap
Journal-literature gap
Little or no relevant research has been identified in the journal literature searched.
Evidence gap
Available evidence across relevant sources remains insufficient to answer the research question adequately.
A researcher can legitimately study publication patterns in journals, in which case the first condition may itself be important. But if the rationale is that "we do not know the answer," evidence outside journals may directly challenge that claim.
This distinction is one reason rigorous evidence-synthesis methods look beyond conventional journal databases when appropriate. Cochrane recommends searching relevant grey literature sources such as reports, dissertations, theses, and conference abstracts as a highly desirable practice for intervention reviews, partly to identify as much relevant evidence as possible and reduce the risk of publication bias.
Why does useful research remain outside journals?
There are many possible reasons. A dissertation may contain a substantial study that its author never converts into a journal article. Government agencies and organizations may conduct evaluations primarily to inform policy or operations rather than academic publication. Conference findings may never progress to full journal articles. Studies with disappointing, null, or inconclusive findings may also be less visible in conventional publication channels.
The absence of a journal article therefore does not establish the absence of research activity or evidence.
Grey literature matters because publication processes can shape what becomes visible
Publication bias occurs when the dissemination of research findings is influenced by the nature or direction of the results. One consequence is that published journal literature may not perfectly represent all studies that have been conducted.
Searching unpublished and grey sources can sometimes reveal studies that would otherwise remain outside an evidence synthesis. Cochrane explicitly links extensive searching, including relevant grey literature, with efforts to reduce the risk of publication bias.
This does not mean grey literature magically removes publication bias. Grey sources themselves can be difficult to identify systematically, and what is retrievable may still represent only part of what was produced. The important point is that journal publication status should not automatically determine whether evidence is relevant to your gap.
Not every research project needs an exhaustive grey-literature search
The appropriate search depends on the question and the strength of the claim.
If you are making the narrow statement that "few peer-reviewed journal studies have examined X," grey literature does not contradict that statement. If you are claiming that "little evidence exists about X," the scope is broader, and excluding potentially important non-journal evidence becomes harder to justify.
Gap Claim
Potential Role of Grey Literature
What to Ask
Few journal articles exist
May not eliminate the claim
Is the publication venue itself relevant to the question?
Little empirical evidence exists
Potentially decisive
Do theses, reports, proceedings, or registries contain empirical studies?
A population has not been studied
Potentially decisive
Have dissertations, evaluations, or organizational studies examined that population?
An intervention has not been evaluated
Potentially decisive
Do trial registries, reports, or agency evaluations contain relevant studies?
A policy has not been examined
Often important
Have governments, NGOs, think tanks, or institutions evaluated its implementation or effects?
Grey literature still needs critical appraisal
Finding a dissertation or government report does not automatically fill the gap. The document must actually contain evidence capable of addressing the question.
Evaluate its research design, sampling, measurement, analysis, transparency, relevance, and limitations just as you would critically evaluate a journal article. The appropriate appraisal criteria depend on the type of evidence.
Watch Out
Do not treat "grey literature" as synonymous with either "low quality" or "trustworthy because it avoided publishing bias." The category describes dissemination more than methodological quality. Individual sources still require evaluation.
Peer review status and evidential value are not identical
Peer review can provide useful scrutiny, but journal publication is not a guarantee that a study is methodologically strong. Conversely, the absence of conventional journal peer review does not make a well-designed dissertation, government analysis, or technical report evidentially meaningless.
The correct question is not simply, "Was this published in a journal?" Ask, "What kind of source is this, how was the research conducted, and what can I legitimately infer from it?"
Grey literature can be harder to find systematically
One reason researchers overlook grey literature is practical. Bibliographic journal databases offer relatively structured metadata and search interfaces. Grey literature is scattered across repositories, organizational websites, registries, conference archives, dissertation databases, and other sources with varying search capabilities.
Searching it may therefore require multiple approaches rather than one universal database. Relevant methods can include targeted repository searching, organization or government website searches, dissertation databases, trial registries, web searching, reference checking, and consultation with subject specialists or librarians.
For a consequential gap claim, the sources chosen should follow the likely location of the evidence rather than a generic requirement to "search grey literature."
Sometimes grey literature reveals a better gap
Imagine that journal searching suggests nobody has evaluated a particular educational program. You then find five institutional evaluations. The claim that the program has never been evaluated is gone.
But perhaps all five reports use uncontrolled satisfaction surveys. Now the problem is not absence of evaluation. It is the weakness of evidence about effectiveness.
That is a more informative gap because it emerges from what existing evidence can and cannot establish. A stronger search has replaced an inaccurate absence claim with a methodological or evidential problem.
When sparse journal results initially suggest novelty, first ask whether you are observing an apparent gap produced by the boundaries of your literature search .
06 · What This Means for You
Decide Whether Your Gap Is About Publications or Knowledge
Before deciding how extensively to search grey literature, clarify what you are actually claiming.
A simple decision framework
If your claim concerns specifically the peer-reviewed journal literature
State that scope clearly. Grey literature may provide useful context without contradicting the narrower publication claim.
If your claim is that little empirical evidence exists
Consider relevant grey-literature sources capable of containing empirical research.
If the topic involves government, policy, industry, professional practice, or institutional programs
Give particular attention to reports, repositories, evaluations, and organizational sources where relevant work may naturally be disseminated.
If grey literature directly answers the question
Revise or abandon the original absence claim, then determine what limitations or unresolved questions remain.
If grey literature exists but provides weak or incomplete evidence
Frame the gap around what the available evidence cannot establish rather than claiming that no research exists.
This distinction can substantially improve the rationale for a study. "No journal article was found" is a statement about publication and retrieval. "Available evidence cannot answer this question adequately" is an argument about knowledge. The latter requires more work, but it is usually much closer to what researchers actually need to establish.
Before committing to the resulting claim, stress-test the proposed gap against evidence that could make it disappear .
07 · A Quick Checklist
Before Treating a Journal-Literature Gap as an Evidence Gap
Before concluding that little or no evidence exists, check:
Am I claiming a gap specifically in journal publications, or a broader gap in available evidence?
What types of grey literature are reasonably likely to contain research on this particular topic?
Have I checked relevant dissertation and thesis sources when graduate research is likely to matter?
For policy, program, or applied questions, have I examined relevant government, institutional, professional, or organizational reports?
Are conference proceedings, registries, or other specialized sources relevant to the type of evidence I need?
Have I critically appraised relevant grey sources rather than including or excluding them solely because of publication status?
Have I checked whether multiple reports describe the same underlying study?
If grey literature exists, have I revised my gap claim to reflect what the combined evidence actually leaves unresolved?
11 · Cite this Guide
How to Cite This Guide
This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.
Recommended (Field Guide)
APA
MLA
Chicago
Copy Citation
