03 · What You Need to Know
Quantity Is One Possible Indicator, Not a Complete Quality Model
First Ask Whether Research Quantity Is Actually Part of the Standard
The first mistake is assuming that every accreditation system rewards publication volume. Accreditation requirements differ among countries, agencies, programs, and institution types.
An external framework may specify quantitative research evidence. It may instead require evidence of scholarship, research capability, research training, integrity, or mission fulfillment. Some frameworks distinguish expectations according to whether an institution has substantial research responsibilities.
Before establishing a target, universities should therefore verify the current official standards and determine exactly what the indicator measures.
If Quantity Is Explicitly Measured, More Eligible Output Can Matter
Suppose an evaluation system awards points according to the number of qualifying research outputs. Holding everything else constant, increasing the number of eligible outputs can improve performance on that specific indicator.
This is a mathematical consequence of the indicator, not evidence that research quantity universally improves accreditation.
The qualification matters because outputs may need to satisfy definitions concerning type, period, authorship, indexing, peer review, institutional affiliation, or other conditions. A paper that does not meet the framework's definition may add nothing to the score.
An Indicator Score and an Accreditation Outcome Are Different Things
Accreditation generally involves multiple standards. Even substantial improvement in research output may not compensate for weaknesses elsewhere if the framework requires minimum performance across several domains.
Research indicator performance
How the institution performs on a particular research measure used within an evaluation framework.
Accreditation outcome
The broader decision produced by applying the complete set of applicable standards, rules, evidence, and review processes.
A university could improve its publication count while still having deficiencies in teaching, student support, governance, research integrity, infrastructure, postgraduate supervision, or another area relevant to the applicable framework.
More Publications Do Not Necessarily Mean Better Publications
Quantity and quality are empirically distinct. A study of Chilean universities examining institutional accreditation alongside research indicators found that accreditation was more strongly associated with publication quantity than with measures intended to capture research quality and impact. Importantly, the study also reported no general relationship between the number of publications and their quality, with negative correlations appearing in some cases.
This finding comes from a particular national system and set of bibliometric indicators, so it should not be generalized to all countries. It nevertheless illustrates why publication volume should not be treated as a substitute for research quality.
Research Quality Is Difficult to Reduce to One Number
Quality can refer to methodological rigor, originality, credibility, transparency, significance, reproducibility where applicable, contribution to knowledge, or fitness for purpose. No single bibliometric indicator captures all of these dimensions.
Journal quartiles, citation measures, indexing status, peer review, funding success, and publication counts can provide information about aspects of the research environment or scholarly reception. None independently proves that an individual study is high quality.
Quality assurance therefore needs judgment and multiple forms of evidence rather than assuming that one number can carry the entire evaluation.
Output Targets Can Change Researcher Behavior
Targets are not passive measurements. Once careers, budgets, accreditation, or institutional status depend on them, people have reasons to optimize performance against those targets.
This can produce desirable behavior. Researchers may become more active, complete unfinished work, seek collaborations, strengthen writing support, or disseminate findings that would otherwise remain inaccessible.
It can also produce undesirable behavior if the target is too narrow. Researchers may prioritize questions that generate outputs quickly, divide studies into smaller publication units, avoid time-consuming research, or focus heavily on the kinds of outputs recognized by the metric.
These possibilities do not mean quantitative targets are always inappropriate. They mean institutions should evaluate what behavior a target is likely to reward.
Accreditation Pressure Can Increase Research Production
Evidence from Ecuador shows how strongly external evaluation can influence institutional behavior. Following national evaluation and accreditation reforms that emphasized research indicators, Ecuadorian universities substantially increased scientific production indexed in Scopus. The study examining this change interpreted accreditation and evaluation processes as important drivers of the increase.
This demonstrates that accreditation systems can stimulate research activity. It does not establish that every additional output was equally valuable or that publication growth alone represented comprehensive improvement in research quality.
Producing More Research Can Strain Weak Research Systems
If an institution substantially increases research expectations without strengthening the systems that support research, unintended problems can follow.
More projects require more supervision, ethics review, data management, research administration, methodological support, funding, library access, computing, and time. More manuscripts require researchers capable of conducting and reporting the underlying studies appropriately.
This is why institutional research capacity matters. Increasing output sustainably requires more than asking the same people and systems to produce more.
Quantity Can Be Especially Misleading Across Disciplines
Publication practices differ dramatically. Some fields commonly publish multi-author journal articles several times per year. Others produce monographs, creative works, lengthy field studies, critical editions, conference proceedings, datasets, software, patents, or other outputs on different timelines.
A uniform numerical target can therefore create unequal incentives across disciplines unless the framework explicitly accounts for these differences.
This is one reason accreditation and research-assessment criteria should be interpreted in their actual disciplinary and institutional context.
Quality Assurance Should Examine the System Producing the Research
A university interested in sustainable research quality needs to know more than how many papers appeared. It should understand whether researchers have appropriate expertise, whether studies receive necessary ethical oversight, whether data are managed responsibly, whether postgraduate researchers receive adequate supervision, and whether institutional systems identify and address problems.
As explained in the role of research in university accreditation and quality assurance, some frameworks may consider research strategy, capability, integrity, resources, and research training alongside outputs.
| What increases? |
What it can legitimately indicate |
What it does not automatically prove |
| Number of publications |
Greater publication output under the chosen definition |
Greater methodological quality or importance |
| Number of indexed publications |
More outputs covered by the specified database |
That every article is rigorous or valuable |
| Citation count |
More scholarly references to the work |
Research quality, correctness, or societal impact |
| Grant income |
Greater success obtaining research resources |
That every funded study produces high-quality findings |
| Number of research projects |
Greater recorded project activity |
That projects are well designed, completed, or useful |
| Researcher participation |
Broader involvement in research activity |
That participants have adequate time, expertise, or support |
Mission Alignment Still Matters
Even when accreditation encourages research, institutions should ask what kind of research fits their mission. A teaching-focused university may reasonably emphasize research that enriches faculty scholarship, student inquiry, regional problems, or selected areas of institutional expertise. A doctoral research university may need broader and deeper research capability.
Maximizing output without considering mission can divert resources from activities the institution exists to provide.
More Research Can Create Opportunity Costs
Faculty time devoted to additional research cannot simultaneously be devoted to teaching, supervision, clinical service, community engagement, administration, or other responsibilities. Institutional funding allocated to publication incentives cannot be spent on laboratories, student support, libraries, or researcher development.
This does not mean research should receive fewer resources. It means research targets are resource-allocation decisions, not free additions to institutional activity.
Research Quantity Can Be Valuable Without Becoming the Definition of Success
An institution with almost no research activity may reasonably seek greater output. Publication counts can help determine whether research is occurring at all and can identify trends over time.
The problem arises when quantity becomes the complete objective. At that point, the institution risks confusing the evidence used to monitor research with the reason research is valuable.
Watch Out
Do not create publication targets from hearsay about accreditation. Verify the official standard, its definitions, evidence requirements, scoring rules, and current version. An internal target can become institutional policy remarkably quickly even when the external accreditor never required it.
The Best Response to an Accreditation Weakness Depends on the Weakness
If reviewers identify insufficient research activity, additional credible research may be part of the response. If they identify weak ethics oversight, publishing more does not solve the problem. If postgraduate supervision is inadequate, the response should strengthen supervision. If infrastructure is insufficient, the institution needs appropriate resources.
Quality improvement should therefore respond to the diagnosed deficiency rather than defaulting to the most visible research metric.