Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

What Criteria Should You Use to Compare Research Ideas?

Good research ideas should not be compared on novelty or feasibility alone. Use criteria that capture both the value of the question and your ability to investigate it rigorously under realistic conditions.

183
Criteria for Comparing Research Ideas Guide 183 of 533
01 · The Question

What Should You Actually Compare When Several Research Ideas Look Good?

Once you have several plausible research ideas, saying that one simply “feels stronger” is rarely enough. You need some basis for comparing them.

But which characteristics deserve attention? Importance? Originality? Feasibility? Available data? Personal interest? Publication potential?

Established approaches to research-question development already suggest that worthwhile research is multidimensional. The FINER framework, for example, asks whether a question is feasible, interesting, novel, ethical, and relevant. Formal research assessment frameworks likewise distinguish scientific importance from rigor and feasibility and consider whether appropriate expertise and resources are available.

The useful criteria therefore extend beyond asking which idea sounds most exciting.

02 · The Short Answer

Compare Both the Value of the Question and Your Ability to Answer It Well

In Brief

When comparing research ideas, consider their potential contribution, importance or relevance, originality where it matters, feasibility, ethical acceptability, methodological answerability, access to suitable evidence, required expertise and resources, uncertainty, and fit with your research circumstances.

These criteria do not need equal weight, and some should function as minimum requirements rather than tradeable advantages. The appropriate comparison depends on the discipline, type of study, researcher, and purpose of the project.

03 · What You Need to Know

The Criteria That Help Distinguish a Promising Idea From a Pursuable Study

Potential Contribution: What Would Change If You Answered the Question?

Begin with the contribution the study could make. A research project consumes time, expertise, participant effort in some fields, institutional resources, and often funding. There should be a defensible reason to conduct it.

Contribution can take different forms. A study might address an important unresolved question, challenge an established explanation, extend evidence to an inadequately studied context, improve measurement or methodology, resolve conflicting findings, or produce knowledge useful to practice or policy.

This does not require every project to promise a dramatic breakthrough. NIH's current peer-review framework asks reviewers to assess whether proposed research addresses an important knowledge gap, solves a critical problem, or creates a valuable conceptual or technical advance. It also explicitly recognizes that research can be critically important without relying on highly novel concepts or approaches.

A practical question is: If this study is completed well, what credible contribution could it make?

Importance and Relevance: Does the Question Deserve Attention?

Contribution and importance overlap, but they are not identical. Contribution concerns what new knowledge the study may produce. Importance concerns why producing that knowledge matters.

Relevance may be scientific, theoretical, methodological, practical, clinical, educational, social, or policy-related depending on the field. FINER explicitly includes relevance to scientific knowledge and, in its clinical formulation, relevance to clinical and health policy and future research.

Importance should nevertheless be argued rather than assumed. A topic affecting many people may contain a narrowly consequential research question, while a question concerning a relatively small population may address a serious unresolved problem.

Feasibility: Can You Conduct the Study Properly?

Feasibility asks whether the idea can become a rigorous study under realistic conditions. In FINER, this includes considerations such as adequate participants, technical expertise, affordability in time and money, and manageable scope.

NIH similarly evaluates whether proposed studies can be done well within the proposed timeframe and whether the approach is sound and achievable. Depending on the study, feasibility may involve recruitment, data access, equipment, software, laboratory capacity, permissions, funding, collaborators, or time.

Feasibility should not be confused with ease. A difficult project may still be highly feasible if the necessary capabilities are available. An apparently simple project may become infeasible if its essential data cannot be obtained.

This criterion becomes particularly important when a more important question is substantially harder to execute.

Methodological Answerability: Can the Proposed Evidence Actually Answer the Question?

An idea may be interesting and feasible in a logistical sense yet poorly matched to the evidence or design available.

A well-defined research question helps determine study design, population, data collection, and analysis. Research-question guidance has long emphasized that poorly formulated questions can lead to inappropriate designs and results that do not meaningfully address the intended problem.

Ask whether there is a defensible empirical or analytical path from the research question to an answer. If the available method can address only a weaker or different question, either refine the idea or acknowledge what the study can actually establish.

Ethical Acceptability: Should the Study Be Conducted in the Proposed Form?

Ethics is not merely another attractive characteristic. FINER treats ethical acceptability as a basic characteristic of a good research question, and research involving humans, animals, sensitive data, or consequential interventions may require additional formal safeguards and approvals.

This is one reason an ethical problem should not simply receive a low score and then be compensated for by high scores elsewhere.

Watch Out

Do not use an overall score to make a fundamentally unacceptable study appear acceptable. Some criteria establish whether an idea can remain under consideration at all.

Originality: What Is New About the Proposed Contribution?

Originality matters, but it requires careful interpretation. FINER defines novelty broadly enough to include research that confirms, refutes, or extends previous findings. NIH similarly notes that a project without highly novel concepts or approaches can still be critically important.

Accordingly, originality should not be reduced to “Has nobody ever studied this before?” A study can make an original contribution through a new question, population, context, theoretical interpretation, dataset, method, comparison, or synthesis, provided that the difference is consequential rather than cosmetic.

When two ideas differ sharply here, examine what originality and practical relevance actually contribute to each option rather than automatically privileging one.

Access to Suitable Evidence: What Will You Actually Be Able to Observe?

Data availability deserves explicit consideration because your conclusions are constrained by the evidence you can obtain.

For primary research, this might concern access to participants, sites, records, instruments, archives, samples, or observations. For secondary research, it may involve dataset coverage, variable quality, missingness, documentation, access restrictions, or whether the data correspond to the constructs in the research question.

Better data should not automatically defeat a more important question. But differences in data access can change which study is scientifically executable, not merely which one is convenient.

Expertise and Resources: Can You or Your Team Do the Work Well?

A study can be feasible in principle but not feasible for the current research team. Some projects require statistical, qualitative, computational, laboratory, clinical, linguistic, technical, or disciplinary expertise that is not readily substitutable.

NIH explicitly considers whether investigators possess appropriate background, training, and expertise and whether institutional resources are suitable for successful execution. This is a useful reminder that research ideas are pursued by actual teams in actual environments.

A gap in expertise does not necessarily eliminate an idea. It may instead identify the collaborator, training, infrastructure, or methodological consultation required before proceeding.

Uncertainty and Research Risk: How Fragile Is the Path to a Useful Result?

Research necessarily involves uncertainty. The relevant question is what kind of uncertainty an idea carries and whether its potential contribution justifies it.

A project may depend on uncertain recruitment, an untested method, difficult measurement, a speculative mechanism, or access that has not yet been secured. These uncertainties do not all have the same consequences.

NIH's current feasibility guidance explicitly asks reviewers, where feasibility is less certain, to consider whether that uncertainty is balanced by the potential for major advances. That is a useful principle beyond grant review: risk should be interpreted alongside potential value rather than treated as automatically good or bad.

This becomes especially relevant when deciding whether a riskier research idea is worth pursuing.

Personal Interest and Intellectual Fit: Will You Want to Stay With the Question?

FINER includes whether the answer interests the investigator, peers, and community. Personal interest is therefore not frivolous. Research often requires prolonged attention, repeated problem-solving, and tolerance for frustrating stretches in which the data stubbornly decline to behave like the methods textbook promised.

Still, personal enthusiasm does not rescue a weak question. It is more defensible as one consideration among scientifically viable alternatives, particularly when two ideas are otherwise closely matched scientifically.

Strategic Fit: Does the Idea Make Sense in Your Present Research Context?

Some considerations are contextual rather than intrinsic to the research question. An idea may connect with your developing expertise, available collaborators, an existing dataset, a larger program of work, or an opportunity to build capabilities needed for subsequent studies.

This criterion should be used carefully. Strategic convenience should not replace scientific justification. But when several ideas are worthwhile, it can reasonably affect which one you pursue first.

Publication or Funding Potential: Usually Secondary, Sometimes Relevant

Researchers operate within institutions, careers, funding systems, and publication environments, so pretending these considerations never matter would be unrealistic. The problem arises when they become substitutes for scientific merit.

Publication potential may reasonably influence a genuinely close choice, but a fashionable or easily publishable topic is not automatically a stronger research question. Similarly, funding prospects may affect whether a resource-intensive study can actually happen, but fundability and scientific importance are not synonymous.

These factors are usually better treated as contextual or tie-breaking considerations after the scientific case has been established.

You Do Not Need Every Criterion for Every Decision

A useful framework should discriminate among your alternatives. If all three ideas require essentially the same resources, resource availability may not help distinguish them. If none involves meaningful differences in data access, that criterion may deserve little attention in the comparison.

Conversely, a criterion omitted from a generic framework may be decisive in a particular field. A longitudinal study may depend heavily on participant retention. An archival project may depend on access permission. A computational project may require resources that make scale a central feasibility issue.

The criteria should serve the decision, not become a form that must be completed for its own sake.

04 · A Practical Example

Comparing Research Ideas Using Criteria That Actually Distinguish Them

Hypothetical Example

Choosing between three studies of generative AI in higher education

Suppose a researcher has three plausible ideas. Idea A investigates a consequential but difficult-to-recruit student population. Idea B uses an accessible institutional dataset to address a narrower question. Idea C tests a novel intervention but requires technical expertise not currently present on the team.

Criterion Idea A Idea B Idea C
Potential contribution High Moderate Potentially high
Feasibility Moderate High Low at present
Originality Moderate Moderate High
Evidence access Uncertain Strong Moderate
Required expertise Available Available Important gap
Major uncertainty Recruitment Limited scope of existing variables Technical execution

The comparison does not produce an automatic winner. Instead, it identifies what each choice would require.

Idea A: Verify whether recruitment is realistically achievable. If it is, the idea's potential contribution may justify the additional difficulty.
Idea B: Determine whether the available variables can actually answer a sufficiently meaningful question rather than choosing the study merely because the data are convenient.
Idea C: Determine whether the expertise gap can be addressed through collaboration or whether the project should wait until the necessary capability exists.

The criteria have therefore done more than label the ideas. They have identified the conditions under which each could become the strongest choice.

05 · What Researchers Often Get Wrong

Common Mistakes When Comparing Research Ideas

Misconception

Originality Should Always Receive the Most Weight

Novelty can strengthen a contribution, but neither FINER nor current NIH review guidance treats novelty as sufficient by itself. Research that extends, confirms, or rigorously examines an important problem may be valuable without being radically new.

Misconception

Feasibility Means Choosing the Easiest Study

Feasibility concerns whether the study can be conducted adequately, not whether it requires minimal effort. A difficult but achievable study can be a stronger choice than an easy project with little expected contribution.

Misconception

Available Data Automatically Make an Idea Stronger

Data access is valuable only when the evidence is suitable for answering a worthwhile question. Convenient data can tempt researchers to reverse the logic of study design by asking whatever question the dataset happens to permit.

Misconception

Every Criterion Should Count Equally

Criteria have different roles. Ethical acceptability may function as a threshold, contribution may deserve substantial weight, and publication potential may be only a secondary consideration. Equal weighting is not inherently more objective.

Misconception

The Same Criteria Work Equally Well for Every Researcher

Core scientific considerations travel reasonably well across settings, but feasibility and strategic fit depend partly on the study, discipline, team, resources, and timeframe. The comparison should reflect those conditions without lowering standards of rigor or ethics.

06 · What This Means for You

Build Your Comparison Around Value, Viability, and the Specific Trade-Offs You Face

Start by asking whether each idea can become an ethically and methodologically defensible study. Then compare the viable alternatives on criteria that meaningfully affect their potential contribution and your ability to execute them.

A simple decision framework

If an idea cannot be studied ethically or cannot answer its proposed question
Redesign it before treating it as a serious competitor.
If several ideas remain scientifically viable
Compare their expected contribution, importance, feasibility, originality where relevant, evidence access, expertise requirements, and major uncertainties.
If one idea is attractive mainly because it is easy
Ask whether the resulting contribution remains sufficient to justify conducting the study.
If one idea is attractive mainly because its potential contribution is large
Ask whether there is a credible methodological and operational path to realizing that contribution.
If two ideas remain closely matched
Consider secondary factors such as personal interest, strategic fit, publication opportunities, funding, or sequencing within a larger research agenda.

If you want to formalize the comparison, you can rank the remaining research ideas. The purpose of doing so is not to manufacture an objective winner. It is to make your assumptions and trade-offs easier to inspect.

07 · A Quick Checklist

Before Comparing Your Shortlisted Research Ideas

For each serious research idea, check:
What specific contribution could the completed study make?
Why is the question important or relevant to the field, practice, policy, theory, or another appropriate audience?
Can an appropriate study design and evidence actually address the question?
Is the study ethically acceptable in its proposed form?
Is the project feasible given realistic time, access, funding, recruitment, infrastructure, and scope?
What is genuinely original, confirmatory, extending, or otherwise informative about the proposed contribution?
Can you obtain evidence of sufficient quality and relevance?
Do you or your collaborators have the expertise and resources required to conduct the work rigorously?
What major uncertainty could prevent the project from producing a useful result?
Are secondary considerations influencing the choice more strongly than the scientific case warrants?
08 · Frequently Asked Questions

Questions About Criteria for Choosing Between Research Ideas

What are the most important criteria for choosing a research idea?

There is no universal weighting, but the potential contribution, importance or relevance, methodological answerability, feasibility, ethical acceptability, evidence access, and required expertise usually deserve attention. Other criteria depend on the project and context.

Is FINER enough to compare research ideas?

FINER provides a useful established framework covering feasibility, interest, novelty, ethics, and relevance. You may still need more specific considerations such as data access, methodological fit, required expertise, or project-specific constraints when comparing actual alternatives.

Should originality matter more than feasibility?

Not as a universal rule. A highly original project that cannot be conducted adequately may produce little useful knowledge, while a feasible project with no meaningful contribution is also weak. Their relative importance depends on the magnitude and consequences of the differences.

Is personal interest a legitimate selection criterion?

Yes, provided the ideas under consideration are scientifically defensible. Investigator interest is included in FINER, but enthusiasm should not compensate for fundamental problems in importance, ethics, methodology, or feasibility.

Should publication potential be one of my criteria?

It can be a secondary consideration when publication is relevant to your objectives. It should not replace the question of whether the proposed research is worthwhile and capable of producing defensible knowledge.

Do I need to score every criterion?

No. A structured qualitative comparison may be enough. Scoring becomes useful when several ideas have competing strengths and you need a more explicit way to inspect the trade-offs.

Can the criteria change depending on the type of study?

Yes. Core considerations such as ethics, methodological adequacy, contribution, and feasibility remain relevant, but their operational meaning can differ substantially across experimental, qualitative, computational, archival, observational, clinical, and other forms of research.

09 · The Bottom Line

Compare Research Ideas on What They Could Contribute and What It Would Take to Deliver That Contribution

The Bottom Line

Use criteria that capture both the scientific value of a research idea and whether you can investigate it rigorously, ethically, and realistically, rather than choosing on originality, importance, feasibility, or convenience alone.

Start with contribution and scientific relevance, screen for essential ethical and methodological requirements, then examine feasibility, originality, evidence access, expertise, uncertainty, and relevant contextual considerations. The purpose is not to find a universal formula for the best idea but to make the trade-offs behind your particular choice explicit.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes