03 · What You Need to Know
Why the Number of People Affected Is Only One Measure of Importance
Research Relevance Is Broader Than Population Size
Useful frameworks for evaluating research questions do not define relevance simply by asking how many people experience the problem. The FINER criteria, for example, ask whether a research question is feasible, interesting, novel, ethical, and relevant. Relevance can concern scientific knowledge, practice, policy, decision-making, or future research.
That immediately broadens the meaning of significance. A research problem may matter because it affects many people, but it can also matter because resolving it changes what researchers know, improves a consequential decision, corrects an important methodological weakness, or advances future research.
So prevalence is evidence about one possible dimension of importance. It is not a universal threshold for deciding whether research deserves to exist.
Scale and Severity Are Different
Imagine two hypothetical problems. One causes a mild inconvenience for hundreds of thousands of people. Another affects only several hundred people but produces severe, persistent consequences.
Which is more important?
You cannot answer from prevalence alone. You need to know what the consequences are, how serious they are, how long they persist, whether they can be prevented or reversed, and what alternatives are available.
This principle applies well beyond health research. A rare engineering failure may warrant substantial investigation if it creates catastrophic risk. A problem affecting a small population of students may matter if the consequences are severe and systematically restrict educational opportunities. A relatively uncommon methodological error may deserve attention if it substantially distorts influential research findings.
Numbers help describe scale. They do not, by themselves, measure significance.
Prevalence or scale
How common the problem is, how often it occurs, or how many people, cases, systems, or settings it affects.
Significance
Why resolving the problem matters, considering its scale together with severity, consequences, knowledge value, equity, decisions, and other relevant factors.
A Small Population Can Experience a Large Burden
A problem's burden is not determined only by the number of people who experience it. The magnitude of the consequence for each affected person can matter substantially.
Consider a rare condition that severely restricts daily functioning, an uncommon occupational exposure associated with serious harm, or a barrier that affects a small group but effectively prevents them from accessing an essential service. A simple count may make each problem appear small while concealing the intensity of its consequences.
Depending on the research problem, you may therefore need to consider severity alongside prevalence. Useful questions include:
- How serious is the consequence for those affected?
- How long does it last?
- Is the effect reversible?
- Does it affect safety, health, opportunity, livelihood, or another consequential outcome?
- Are effective alternatives already available?
- Does the problem compound other disadvantages?
The answers can make a relatively uncommon problem highly significant.
Who Is Affected Can Matter as Much as How Many
Suppose a problem affects a small population that is already poorly represented in existing evidence. The small population size does not make the evidence need disappear.
In some cases, repeatedly prioritizing only the largest populations can leave smaller groups with persistent uncertainty about interventions, services, risks, or policies that affect them. The relevant significance argument may therefore involve equity as well as prevalence.
This does not mean that every underrepresented population automatically justifies a new study. You still need a genuine research problem and a reason the missing evidence matters. But it does mean that identifying who the research problem matters to is often more informative than counting people alone.
A Small Problem Can Influence a High-Stakes Decision
Some research problems matter because of the decisions attached to them.
Imagine a specialized medical procedure performed relatively infrequently. A question about one serious complication may concern a small number of patients overall, but clinicians still need dependable evidence when deciding how to reduce that risk.
Or imagine a safety issue that arises only under unusual industrial conditions. Few workers may ever encounter it, yet the consequence of making the wrong decision could be severe.
The significance comes partly from the combination of uncertainty and stakes. If people must make consequential decisions and the available evidence cannot adequately guide them, resolving the uncertainty may have substantial value even when the number of cases is modest.
Some Research Problems Do Not Directly Affect People at All
The assumption that an important problem must affect many people works particularly poorly for basic, theoretical, and methodological research.
Suppose researchers discover that a widely used measurement instrument systematically fails to distinguish two important constructs. The immediate “population affected” may simply be researchers using that instrument. Yet the methodological problem could influence dozens of studies and distort conclusions built from them.
Likewise, an unresolved contradiction in a theory may have no immediate public consequence but could materially affect how an entire research area understands a phenomenon.
Research questions can be relevant to scientific knowledge and future research as well as to immediate practice or policy.
In these cases, asking how many people are directly affected may be the wrong significance test altogether.
A Narrow Problem Can Have Broader Scientific Value
Research often studies a bounded case because it provides leverage on a larger question.
A rare phenomenon may expose the limits of an established explanation. An unusual environment may reveal a mechanism that is difficult to observe elsewhere. A small population may provide evidence about a process with broader theoretical relevance.
The fact that the immediate phenomenon is uncommon therefore does not necessarily limit the value of the knowledge produced.
However, you should not assume broader significance merely because it is possible. Explain the connection. What general concept, mechanism, method, or theory could the narrow case help researchers understand? What evidence would your study actually provide?
A credible narrow contribution is stronger than an unsupported claim that a small study will transform an entire field.
Local and Small Are Not the Same as Trivial
A problem can be geographically restricted and still have substantial consequences.
A contamination problem affecting one community, an implementation failure at one hospital, or a barrier experienced by students at one institution may warrant systematic investigation when important decisions depend on understanding it.
Local research can also be useful because context matters. Evidence generated elsewhere may not answer a local decision when relevant populations, infrastructure, institutions, environmental conditions, implementation processes, or constraints differ meaningfully.
The key is not to claim universal significance when the evidence is local. Explain why the local problem matters within its actual scope. A small or local problem can be worth researching without pretending that it affects everyone.
A Widespread Problem Can Still Produce a Weak Research Question
The reverse mistake is equally important.
Suppose millions of people experience a particular problem, but the question you propose has already been answered convincingly. Or perhaps your proposed study measures an outcome too trivial to influence understanding or decisions. The broad problem remains important, but your specific research question may contribute little.
This distinction is essential:
A large problem does not automatically make every study about it important.
You still need to identify what consequential uncertainty remains and what your study can realistically contribute. Research-question guidance emphasizes relevance alongside feasibility, novelty, ethics, and interest rather than treating the popularity or size of the topic as sufficient.
Small Numbers Can Also Limit What a Study Can Establish
There is an important practical qualification. Saying that a small population can matter does not mean that population size becomes methodologically irrelevant.
If only a limited number of eligible cases exist, some study designs or statistical analyses may be infeasible or too imprecise to answer the proposed question. Researchers may need alternative designs, multiple sites, longer recruitment, different outcomes, qualitative approaches, evidence synthesis, or other methods appropriate to the question and available population.
This is a feasibility issue rather than an importance issue. FINER explicitly separates relevance from feasibility: a question can matter greatly while still being difficult to investigate with the available participants, resources, time, or methods.
Do not conclude that the problem is unimportant merely because recruitment is difficult. Instead, ask whether the study can be redesigned to obtain useful evidence.
Watch Out
Do not use “the population is small but important” as a substitute for demonstrating significance. Explain what makes the problem consequential: severity, inequity, scientific value, high-stakes decisions, neglected evidence, methodological consequences, or another defensible reason.
Research Priority and Research Worthiness Are Not Identical
A problem can be worth studying without being the highest priority.
Suppose five research problems are all scientifically legitimate, ethically acceptable, and potentially useful, but funding exists for only one. Population size may become one criterion among several for deciding which receives resources.
That comparative priority decision does not imply that the other four problems are worthless.
This distinction helps avoid an all-or-nothing view of significance. A small research problem may have enough value to justify a dissertation, specialist study, local evaluation, methodological project, or targeted funding program even if a national funding agency would prioritize another question with broader expected benefit.
To judge whether the problem is worth pursuing, consider its significance in relation to the purpose and scale of the proposed research rather than demanding that every project compete with the largest problems in society.
Evaluate Importance Across Several Dimensions
Instead of asking only how many people are affected, use a multidimensional assessment.
| Dimension |
Question to Ask |
Why It Matters |
| Scale |
How many people, cases, systems, or settings are affected? |
Shows how widespread the problem is. |
| Severity |
How consequential is the problem for those affected? |
A rare problem may impose substantial harm or burden. |
| Equity |
Are affected groups neglected or disproportionately burdened? |
Small populations can have important unmet evidence needs. |
| Decision relevance |
Does unresolved uncertainty affect a consequential choice? |
Evidence can have high value even for relatively few cases. |
| Scientific value |
Could resolving the problem change understanding, theory, or methods? |
Some important research has no immediate population-scale effect. |
| Evidence need |
How much consequential uncertainty actually remains? |
A widespread problem may not require another study if the relevant question is already answered. |
| Contribution |
What can this particular study realistically add? |
Importance should be proportional to the study's actual reach. |
No single row automatically determines the answer. The purpose is to prevent one visible characteristic, especially population size, from standing in for the entire significance judgment.