Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

Does Research Quality Matter More Than Research Quantity in University Rankings?

University rankings reward both research quantity and dimensions intended to represent research quality, but they do so differently. Producing more research can help, yet research that attracts scholarly attention, strengthens reputation, or performs strongly on normalized quality indicators may matter disproportionately.

102
Research Quality vs. Quantity in Rankings Guide 102 of 533
01 · The Question

Is It Better for a University to Publish More Research or Better Research?

University research strategies often confront an apparently simple choice. Should the institution increase the number of publications, or concentrate resources on producing fewer studies with greater quality and influence?

Global rankings seem to make the question even more urgent. Publications contribute to bibliometric datasets. Citations influence major ranking indicators. Research reputation matters. Times Higher Education directly measures research productivity, while QS describes its Research and Discovery lens as reflecting research quality, volume, and reputation.

The temptation is to choose one side: quantity or quality.

Ranking methodologies do not make the distinction that cleanly. Research quantity can affect eligibility, productivity, citation opportunities, and the scale of an institution's scholarly presence. Measures intended to capture research quality or influence can simultaneously reward citation performance, highly cited research, and reputation. The practical relationship is therefore one of interaction rather than simple substitution.

02 · The Short Answer

Both Matter, but Not in the Same Way

In Brief

Research quality does not simply replace research quantity in university rankings: major ranking systems reward both the scale of research activity and indicators intended to capture scholarly influence, excellence, reputation, or quality, with the balance depending on the ranking methodology.

Producing more eligible research can strengthen some indicators and create more opportunities for citation, but quantity alone is rarely sufficient. In QS and THE, citation-related and reputational measures carry substantial weight, while THE also directly measures research productivity and applies minimum research-output requirements for ranking eligibility.

03 · What You Need to Know

Rankings Reward Research Portfolios, Not an Abstract Choice Between Quality and Quantity

First Define What You Mean by Research Quantity

Research quantity usually refers to the volume of research output produced during a defined period. In bibliometric ranking contexts, this often means publications that satisfy the ranking's database coverage and document-type rules.

Quantity can be expressed as total publications, publications per researcher, publications within a subject, or another normalized measure.

These distinctions matter. A large university may produce more total papers simply because it employs more researchers. A productivity indicator attempts to account for some of that difference by relating output to institutional size.

Research Quality Is Harder to Define and Measure

Research quality can involve rigor, transparency, originality, significance, methodological appropriateness, credibility, reproducibility where applicable, or contribution to knowledge. These characteristics cannot be observed directly from publication count.

Rankings therefore use proxies. Citation impact, highly cited research, research reputation, and related bibliometric indicators may provide evidence about scholarly visibility or influence, but they are not complete measurements of the intrinsic quality of every study.

DORA's guidance on quantitative indicators makes this point explicitly: no single indicator can capture the complexity of research quality. Quantitative measures need contextual interpretation rather than being treated as self-explanatory judgments.

QS Rewards Research Through Reputation and Citations Rather Than a Standalone Productivity Indicator

In the current QS World University Rankings methodology, the Research and Discovery lens contributes 50% of the overall score. Academic Reputation carries 30% and Citations per Faculty 20%.

QS does not currently include a standalone research-productivity indicator equivalent to THE's measure. That does not make publication quantity irrelevant.

Publications generate the research corpus from which citations arise, and QS describes its Research and Discovery lens as measuring research quality, volume, and reputation. However, simply increasing the number of papers does not translate mechanically into a higher QS score because citation performance is calculated relative to faculty size and processed according to QS's methodology.

THE Explicitly Rewards Both Productivity and Several Forms of Research Quality

THE makes the quantity-quality distinction more visible in its indicator structure.

Research Productivity contributes 5.5% within the 29% Research Environment pillar. THE calculates productivity using Scopus-indexed journal publications per scholar, scaled for institutional size and normalized for subject.

Research Quality contributes 30% through Citation Impact at 15%, Research Strength at 5%, Research Excellence at 5%, and Research Influence at 5%.

THE research indicator Weight Broad dimension represented
Research Reputation 18% Perceived research excellence among academic peers
Research Income 5.5% Resources attracted for research
Research Productivity 5.5% Publication output relative to scholars and subject profile
Citation Impact 15% Average normalized citation performance
Research Strength 5% 75th percentile of field-weighted citation impact
Research Excellence 5% Presence of publications among the top 10% worldwide by field-weighted citation impact
Research Influence 5% Citation influence considering the importance of citing research

THE therefore explicitly assigns much more weight to its Research Quality pillar than to Research Productivity alone. Yet productivity remains relevant, and research output also affects eligibility and provides the publication base from which quality measures are calculated.

Quantity Can Matter Before Quality Indicators Are Even Calculated

THE's World University Rankings 2026 requires an institution to have at least 1,000 relevant publications over the five-year period from 2020 through 2024, with at least 100 in each year, among its eligibility requirements.

An institution below that threshold can be excluded from receiving a rank regardless of how strong a small number of its publications might be.

This demonstrates an important point: research quantity can sometimes function as a threshold rather than merely a weighted score.

Subject Rankings Complicate the Relationship Further

Publication and citation cultures differ across disciplines, so ranking organizations adjust subject methodologies.

THE's 2026 subject rankings recalibrate research indicators according to disciplinary research cultures. Citation Impact carries 7.5% in Arts and Humanities but 17.5% in several science-oriented subject rankings. Research Productivity is likewise weighted differently among subject areas.

THE also uses subject-specific publication thresholds because research output varies substantially across disciplines.

Consequently, a quantity-versus-quality strategy that appears sensible for one field may be inappropriate for another.

More Publications Create More Opportunities for Influence

At the institutional level, a sufficiently large research portfolio creates more opportunities for individual studies to become influential. If a university produces only a very small volume of research, even excellent individual papers may have limited effect on institution-level metrics.

This is one reason quantity cannot simply be dismissed. Research-intensive universities combine scale with quality rather than treating them as mutually exclusive.

However, the relationship has diminishing strategic value if additional publications contribute little scholarly use, stretch research systems beyond their capacity, or arise mainly because researchers are being pushed to satisfy numerical targets.

A Smaller Number of Highly Influential Papers Can Matter Disproportionately

Citation distributions are skewed. Some publications attract far more scholarly attention than others. Measures such as THE's Research Excellence explicitly reward the number of publications reaching the top 10% worldwide by field-weighted citation impact.

QS's Citations per Faculty can likewise be influenced substantially when an institution's research portfolio attracts strong citation attention relative to faculty size.

This is why simply comparing publication totals can be misleading. Two universities with similar output volumes may produce very different ranking outcomes if their citation profiles differ substantially.

But Highly Cited Does Not Automatically Mean High Quality

The language of “quality” needs caution. Rankings may label pillars or indicators in ways intended to represent research quality, but citations remain indirect evidence.

A paper can be highly cited because it introduces an influential method, addresses a rapidly expanding topic, is controversial, belongs to a very large collaboration, or becomes an important object of criticism. Citation performance does not directly inspect research design or verify findings.

This is why citations matter to university rankings without becoming interchangeable with research quality.

Research Reputation Introduces Another Dimension

QS Academic Reputation contributes 30% to the overall ranking, while THE Research Reputation contributes 18%.

Reputation is neither straightforward quantity nor straightforward quality. It reflects how institutions are perceived by academic peers and can be influenced by accumulated scholarly achievement, visibility, historical standing, influential researchers, networks, and disciplinary strength.

Reputation can also lag behind changes in current research performance. A university cannot reasonably expect one year of increased publication volume to produce an immediate transformation in global academic reputation.

Research Income Can Support Both Scale and Sophistication

THE assigns 5.5% to Research Income. Funding can support laboratories, research staff, data collection, equipment, infrastructure, and larger projects.

This can enable both more research and forms of research that would otherwise be impossible. Yet research income is still not proof of quality. It represents resources obtained within funding systems influenced by competition, national context, discipline, and policy.

The Quality-Quantity Trade-Off Is Often an Institutional Design Problem

Universities sometimes frame the issue as though individual researchers simply need to choose between publishing frequently and conducting excellent work. Institutional conditions shape that choice.

Researchers operating with adequate time, infrastructure, collaboration, research support, postgraduate researchers, and funding may be capable of producing both substantial volume and strong research. Researchers facing unrealistic publication quotas and limited support may respond differently.

This connects ranking strategy with institutional research capacity. Sustainable research volume depends on the system capable of producing it.

More Is Useful Only When the Additional Research Remains Credible

If an institution increases research quantity by strengthening teams, supporting researchers, completing worthwhile projects, and disseminating credible work that previously remained unpublished, greater volume can represent genuine improvement.

If the same increase is achieved by encouraging superficial projects, fragmenting studies unnecessarily, overloading faculty, or prioritizing whatever can be published most quickly, the numerical gain may not represent comparable improvement in the research system.

Watch Out

Do not interpret “quality matters more than quantity” as an invitation to ignore research volume, and do not interpret “quantity matters” as justification for publication quotas detached from disciplinary practice and research capacity. Ranking methodologies can reward both, but neither should become a substitute for credible research.

Ranking Position Is Relative, Not Absolute

Even if an institution improves both the quantity and citation performance of its research, its rank may remain unchanged or fall if competing institutions improve faster.

Rankings order institutions relative to one another after applying their methodology. Improvement in underlying research performance therefore does not guarantee movement in ordinal rank.

This is one reason institutional leaders should distinguish between improving indicator performance and improving ranking position.

Improved research performance The institution produces stronger evidence on relevant research dimensions compared with its own previous performance.
Improved ranking position The institution moves upward relative to other universities after the ranking methodology is applied.

The Better Long-Term Goal Is a Strong Research Portfolio

A mature research strategy does not ask researchers to choose mechanically between “more papers” and “better papers.” It develops an environment capable of producing a sufficient volume of rigorous, useful, visible research appropriate to the institution's mission and disciplines.

Such a strategy may improve ranking indicators, but its value does not disappear if the ranking methodology changes.

04 · A Practical Example

Three Publication Strategies Can Produce Very Different Research Profiles

Hypothetical Example

A University Wants to Strengthen Its Research Ranking Performance

Suppose a university currently produces 2,000 eligible research publications over a defined period and is considering how to invest additional resources.

Strategy A: maximize quantity The institution introduces strong numerical incentives and rapidly increases output to 3,000 publications, but most additional papers receive little scholarly attention and research-support systems become strained.
Strategy B: concentrate only on a small elite Resources are concentrated almost entirely among a few established research groups. Several highly influential papers emerge, but research participation and sustainable institution-wide capability remain narrow.
Strategy C: strengthen the research system The university develops researchers, methods support, collaboration, grant capability, infrastructure, dissemination, and selected areas of research strength. Output increases more gradually, while a larger share of the portfolio achieves meaningful scholarly visibility.

Depending on the ranking, all three strategies could affect indicators differently. Strategy A may improve measures related to volume but generate weaker citation performance than expected. Strategy B may produce strong citation-based results in selected areas but leave limited breadth. Strategy C may take longer to mature but can strengthen both research capacity and several ranking dimensions.

The example does not imply that Strategy C guarantees a higher rank. Competitor performance and ranking methodology still matter. It illustrates why quality and quantity should be considered as properties of an institutional research portfolio rather than isolated targets.

05 · What Researchers Often Get Wrong

Common Misunderstandings About Research Quality and Quantity in Rankings

Misconception

Quality Is All That Matters, So Publication Volume Is Irrelevant

Research volume can affect eligibility, productivity, the size of the citation-generating portfolio, and other ranking dimensions. THE explicitly measures Research Productivity and imposes a minimum publication threshold for overall ranking eligibility.

Misconception

More Publications Always Improve Rankings

Additional publications do not guarantee stronger citation performance, reputation, funding, teaching scores, or other ranking indicators. Overall position also depends on the performance of competing universities.

Misconception

A Highly Cited Paper Is Automatically a High-Quality Paper

High citation performance indicates substantial scholarly referencing, not direct verification of methodological rigor, correctness, transparency, or societal importance.

Misconception

Every Discipline Should Produce the Same Number of Papers

Publication and citation practices differ substantially across fields. Ranking organizations themselves normalize by subject and use different subject-ranking weights or publication thresholds because raw output is not directly comparable across disciplines.

Misconception

If Our Research Indicators Improve, Our Rank Must Rise

Rank is relative. An institution can improve its own research performance while remaining in the same position or moving downward if other universities improve more rapidly or if the methodology changes.

06 · What This Means for You

Do Not Choose Between Quality and Quantity Before Understanding the Indicator

Universities should begin by identifying what constrains their research performance. An institution below an eligibility threshold faces a different problem from one producing large volumes of lightly cited work. A university with strong bibliometrics but weak research reputation faces another problem again.

A simple research portfolio framework

If research volume is genuinely too low for the institution's mission or ranking eligibility
Strengthen sustainable research participation and capacity rather than simply assigning larger publication quotas.
If output is high but scholarly visibility is weak
Examine research relevance, quality, discoverability, accessibility, collaboration, dissemination, and field-normalized citation patterns.
If a small number of researchers generate most institutional performance
Consider whether researcher development, succession, teams, and broader institutional capability need strengthening.
If quality indicators and quantity indicators are both improving
Evaluate whether the improvement is sustainable and aligned with institutional mission rather than assuming rank will automatically rise.
If a proposed intervention would increase output but weaken research standards
Do not treat the expected ranking benefit as justification for compromising credible research.

This distinction prepares the ground for the broader question of whether universities should conduct research specifically to improve their rankings. A ranking may reward research, but that does not necessarily make the ranking the best reason for conducting it.

07 · A Quick Checklist

Before Choosing a Quality or Quantity Strategy, Diagnose the Research Portfolio

Before changing institutional research targets, check:
Which ranking and exact edition is the institution trying to understand?
Does the methodology directly reward publication productivity, citation performance, reputation, research income, or several of these?
Does research volume affect ranking eligibility?
Is publication output being adjusted appropriately for institutional size and disciplinary differences?
Are citation indicators being interpreted as scholarly influence rather than direct measures of research quality?
Is additional output supported by sufficient researcher expertise, supervision, infrastructure, funding, and research administration?
Is research performance broadly distributed or excessively dependent on a few individuals or papers?
Would the proposed strategy strengthen the institution's research capability even if ranking weights changed?
08 · Frequently Asked Questions

Questions About Research Quality, Quantity, and Rankings

Does QS reward research quantity?

Research volume contributes to the broader research profile captured by QS, but the current flagship methodology does not include a standalone publication-productivity indicator equivalent to THE's. Its principal Research and Discovery indicators are Academic Reputation at 30% and Citations per Faculty at 20%.

Does THE reward research quantity?

Yes. Research Productivity contributes 5.5% in THE's 2026 methodology, and institutions must also satisfy a minimum research-output threshold for ranking eligibility. Research quantity nevertheless sits alongside substantially weighted research-quality, reputation, income, and other indicators.

Does THE give more weight to research quality than productivity?

Under the 2026 methodology, the Research Quality pillar contributes 30%, while Research Productivity contributes 5.5% within the Research Environment pillar. However, these categories measure different constructs, and research volume also influences eligibility and the publication base from which bibliometric indicators are derived.

Would publishing fewer but more highly cited papers improve our ranking?

Possibly, but not necessarily. The effect depends on the ranking, existing output volume, faculty size, citation distribution, normalization, eligibility requirements, reputation, other indicators, and competitor performance. There is no universal formula in which fewer highly cited papers always outperform a larger research portfolio.

Should universities set publication quotas to improve rankings?

Not automatically. Publication targets can influence behavior and may be appropriate in some contexts, but a quota detached from disciplinary practices, research capacity, and the actual ranking methodology can encourage output without corresponding improvements in scholarly influence or research quality.

Is citation impact a measure of research quality?

It is better understood as a bibliometric indicator of scholarly referencing or influence. Ranking systems may use citation-based measures as proxies for aspects of research quality, but citation performance does not directly establish methodological rigor, correctness, transparency, or societal value.

Can a university improve research quality without moving up the rankings?

Yes. Ranking position is relative and depends on the methodology and other universities' performance. An institution can improve its research practices, capabilities, and outputs while remaining in the same ranking band or even moving downward relative to faster-improving competitors.

09 · The Bottom Line

Strong Ranking Performance Usually Requires More Than Simply Producing More

The Bottom Line

Research quality and research quantity both matter in university rankings, but they affect rankings through different mechanisms: quantity can support productivity, eligibility, and the scale of the research portfolio, while citation-based, reputational, and excellence indicators reward dimensions of scholarly visibility and influence.

The most defensible institutional strategy is therefore not “quality instead of quantity” or “quantity instead of quality.” It is to build sufficient capacity to produce a sustainable volume of rigorous, useful, and visible research while remembering that ranking indicators remain proxies and that improved research does not guarantee an improved ordinal rank.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes