03 · What You Need to Know
Turn a Long Idea List Into a Research Decision
First Recognize That Idea Generation and Idea Selection Are Different Tasks
Brainstorming rewards openness. Selection requires discrimination.
During idea generation, it is useful to record possibilities without immediately criticizing them. Once you have more plausible projects than you can pursue, continuing to generate alternatives can actually make the decision harder.
Research priority-setting provides a useful general lesson here. Real priority-setting exercises do not merely generate knowledge gaps; they evaluate and rank them. For example, a 2026 Canadian research-priority exercise first generated numerous knowledge gaps and then selected priorities using importance and feasibility before converting those priorities into research questions and methodological plans.
Your personal research decision is much smaller, but the principle transfers: generation creates the option set; evaluation decides where limited research capacity should go.
Capture Every Idea Somewhere You Trust
One reason researchers resist choosing is fear of losing the alternatives. If selecting Idea A feels like permanently abandoning Ideas B through H, commitment becomes psychologically expensive.
Create an idea bank instead.
For each idea, record enough information that your future self can reconstruct why it mattered: the tentative question, what triggered it, why it might matter, relevant papers or search terms, possible evidence, obvious feasibility issues, and what you still need to investigate.
The entry does not need to become a miniature proposal. Its purpose is to let you release the idea from working memory without losing it.
This also helps distinguish genuinely different projects from multiple versions of the same underlying idea.
Group Ideas Before You Rank Them
A list of 20 ideas may not contain 20 independent research directions.
Several may concern the same underlying problem. One might ask what is happening, another why it happens, and another whether an intervention could change it. Other ideas may differ only in population, setting, method, or data source.
Cluster them by their central problem or research territory before comparing them.
Separate topics
The ideas concern substantially different research problems or areas.
Alternative questions
The ideas investigate different aspects of the same larger problem.
Possible study sequence
One question may logically need to be answered before another can be investigated well.
This exercise can shrink an overwhelming list quickly. It can also reveal that some apparently competing ideas could form several studies within the same broader research program.
Convert Interesting Subjects Into Comparable Research Ideas
You cannot fairly compare “AI in healthcare,” “employee loneliness,” and “something about misinformation” because those are broad interests rather than developed project options.
Bring candidate ideas to approximately the same level of specificity.
For each one, try to state:
- the research problem or uncertainty;
- a provisional research question;
- why answering it could matter;
- what evidence would probably be needed;
- the major feasibility requirements.
You do not need full proposals. You need enough development to avoid comparing a carefully investigated option with an attractive but vague idea.
Use Elimination Before Ranking
Not every idea deserves a detailed scoring exercise.
Some candidates have problems serious enough to remove them from the current decision immediately. The necessary population is inaccessible. The project requires data you cannot obtain. The question has already been answered convincingly and you cannot identify a useful replication or extension. The design would be unethical. The project exceeds the available timeframe by a large margin.
Eliminating such candidates is not the same as declaring them bad research ideas universally. An idea can be excellent research and still be unsuitable for you now.
This distinction makes selection easier because feasibility belongs to a particular researcher, project, and moment.
Separate Fatal Constraints From Solvable Problems
Be careful not to eliminate ideas merely because they require work.
“I do not yet know this method” may be solvable through training or collaboration. “The only dataset capable of answering the question is permanently inaccessible to this project” is a different kind of obstacle.
| Constraint |
Question to Ask |
Possible Response |
| Knowledge gap |
Can I learn enough within the available time? |
Training, reading, supervision, or collaboration may solve it |
| Methodological gap |
Is appropriate expertise available? |
Training or collaboration may make the project viable |
| Data access |
Can the necessary evidence realistically be obtained? |
Secure access, change the design, or eliminate the idea |
| Scope |
Can the question be narrowed without destroying its value? |
Refine the project |
| Ethical problem |
Can the design be changed while still answering the question? |
Redesign or eliminate the current approach |
| Timeline |
Can a meaningful version be completed on time? |
Reduce scope, change design, or postpone the project |
The point is not to prefer easy research. It is to distinguish difficulty worth managing from constraints that make a particular project unrealistic.
Then Compare the Survivors on Multiple Criteria
Research ideas are multidimensional decisions. The idea with the strongest novelty may have terrible data access. The easiest project may make only a minor contribution. The most important question may require expertise you cannot obtain.
Useful comparison criteria often include:
- significance of the problem;
- potential contribution;
- feasibility;
- access to appropriate evidence;
- ethical acceptability;
- your sustained interest;
- methodological fit;
- available expertise or supervision;
- fit with the project's purpose and timeframe;
- risk that a critical assumption or dependency will fail.
There is no universal weighting for these criteria. Formal research-priority exercises similarly use multiple criteria rather than treating the existence of a knowledge gap as sufficient. Recent priority-setting work has explicitly considered importance and feasibility when reducing a larger pool of possible research needs.
Do Not Turn the Scorecard Into Fake Precision
A decision matrix can help, but it should expose reasoning rather than manufacture certainty.
Suppose you rate five ideas from 1 to 5 on significance, feasibility, interest, and evidence access. An idea scoring 18 is not scientifically proven to be better than one scoring 17. Your ratings contain judgments, incomplete information, and criteria that may not deserve equal weight.
Use scores to reveal patterns.
If one idea is strong everywhere except data access, investigate data access. If another scores well only because it is extremely easy, ask whether its contribution is strong enough. If two ideas remain close, identify which criterion actually separates them.
The matrix is a conversation with your assumptions, not an algorithm that chooses your research for you.
Distinguish Importance From Personal Excitement
Interest matters. A project that genuinely engages you can be easier to sustain through difficult stages. But excitement and research significance are not identical.
You may be fascinated by an idea whose answer would add little to existing knowledge. Conversely, an important question may initially seem less glamorous because it involves careful replication, measurement, or foundational work.
Do not remove personal interest from the decision. Give it its own criterion so that it does not quietly substitute for every other criterion.
This is particularly useful when personal curiosity is what generated the topic.
Compare the Question, Not the Topic Label
Two broad topics may seem equally attractive while the actual projects inside them differ dramatically.
“Urban biodiversity” and “online misinformation” cannot meaningfully be ranked until you know what study you are considering within each. One may contain a well-defined question, accessible evidence, and a clear contribution. The other may still be only a general fascination.
Selection becomes much easier after preliminary reading converts each broad possibility into a provisional study.
This is why you should know enough about each serious candidate to judge it intelligently without conducting a full literature review for every option.
Look for Dominated Ideas
A useful decision concept is dominance.
Suppose Idea A and Idea B address similarly significant questions, but A has stronger evidence access, better methodological fit, lower ethical complexity, and more appropriate supervision. Unless B has another important advantage, B may not deserve equal attention.
Removing dominated options can simplify a long shortlist without requiring precise numerical rankings.
Be cautious, however, about comparing only convenience. An easy but low-value project does not dominate a difficult but consequential one merely because it is easier.
Investigate the Uncertainty That Could Change Your Decision
Once you have a shortlist, do not research every candidate equally. Ask what you still do not know that could change the ranking.
Perhaps Idea A is clearly strongest if a dataset is accessible. Check that first.
Idea B may be promising unless a recent review shows the question has already been answered. Read the review.
Idea C may depend on recruiting a particular population. Investigate access before spending days refining the theory.
This is decision-focused preliminary research: you are not trying to master every candidate topic. You are resolving uncertainties that determine whether each project survives.
Do Not Combine Ideas Merely Because You Cannot Bear to Lose Them
One of the most common responses to too many ideas is to merge them.
You begin with three possible studies and create one project containing all three populations, outcomes, theoretical perspectives, and methods. Nothing has actually been prioritized; the decision has been transferred into an oversized research design.
Combine ideas only when they answer one coherent central problem and the combined evidence is genuinely needed.
If merging produces a question that asks one study to cover too much territory, keep the projects separate.
Some Ideas Should Be Sequenced Rather Than Compared
Two ideas can both be excellent while one logically comes first.
Suppose Idea A asks whether a phenomenon exists and how it manifests. Idea B asks which mechanism causes it. If the phenomenon itself is poorly established, the descriptive work may need to precede the mechanistic study.
Likewise, intervention research may depend on first understanding the problem well enough to know what intervention should target.
In these cases, asking “Which idea is better?” is the wrong question. Ask “Which question should be answered first?”
Some Ideas Should Be Saved Until Their Constraints Change
A strong research idea can arrive at the wrong time.
You may lack access to the relevant archive today. A dataset may not yet exist. The necessary instrument may be unavailable. You may need methodological training first. A collaborator with essential expertise may not currently be available.
Do not distort the idea merely to make it executable now if doing so removes what makes it valuable.
Mark it as deferred and record what would need to change before it becomes viable. Your idea bank then becomes a research pipeline rather than a graveyard of rejected projects.
Ask Whether an Idea Fits the Researcher You Are Trying to Become
When several candidates are all defensible, strategic fit can become a legitimate criterion.
Which project develops expertise you want to build? Which connects to a longer research agenda? Which gives you experience with a method you expect to use again? Which creates a foundation for later questions you care about?
This should not override research quality. A strategically convenient project still needs a worthwhile question.
But when two options are otherwise strong, the knowledge and capabilities you will develop can reasonably influence the choice.
Supervision and Collaboration Can Change the Ranking
A project is not conducted in an intellectual vacuum.
An idea outside your current expertise may become highly feasible with appropriate supervision. Another may appear straightforward until you discover that nobody available can support the specialized method it requires.
For supervised research, consider not merely whether someone is willing to supervise the topic but whether the necessary substantive and methodological expertise is accessible.
The influence of your supervisor's expertise on topic choice should therefore be evaluated alongside your own interests and the project's requirements.
Know When to Stop Comparing
Selection can become another form of procrastination.
You build increasingly elaborate spreadsheets. You run one more search. You add another criterion. Every option develops strengths and weaknesses, so none becomes obviously perfect.
Research decisions are usually made under uncertainty. The purpose of comparison is not to prove that one idea is objectively superior in every possible future. It is to identify a defensible choice given what you know and the constraints you face.
Once one candidate clearly satisfies the essential requirements and compares favorably with realistic alternatives, the value of further comparison may become smaller than the value of beginning the research.
The Ideas You Reject Can Still Improve the One You Choose
Selection does not always produce clean separation.
Comparing alternatives may reveal a better outcome measure, theoretical perspective, population, method, or framing for the chosen study. One rejected idea may become a secondary question. Another may reveal an important alternative explanation the selected project should consider.
The purpose of prioritization is not to forget everything except the winner. It is to prevent every worthwhile thought from becoming an obligation inside the same project.