Manuel B. Garcia

Manuel B. Garcia serves as the Senior Director for Educational Technology and Digital Learning at FEU Institute of Technology, Manila, Philippines. Read More

Contact Info

1607, FEU Tech Building,
P. Paredes St, Sampaloc,
Manila, Philippines
mbgarcia@feutech.edu.ph

Follow Me

When Should You Bring in a Statistician, Methodologist, or Other Specialist?

Specialists are most useful before difficult research decisions become irreversible. Learn when statistical, methodological, technical, or other expertise should enter your project and what to prepare before asking for help.

452
When Should You Consult a Research Specialist? Guide 452 of 533
01 · The Question

Should You Ask for Specialist Help Now or Wait Until You Actually Need It?

Your research is becoming more complicated than expected. Perhaps you are unsure which design can answer the question, how large the sample should be, whether your planned analysis fits the data, how to develop an instrument, how to manage a complex dataset, or how to integrate qualitative and quantitative evidence.

You know that a statistician, methodologist, data scientist, qualitative researcher, psychometrician, programmer, laboratory specialist, or another expert might help. But when should that person become involved?

Researchers sometimes wait until the difficulty becomes unavoidable. For statistical work, that often means contacting someone after data collection with a spreadsheet and asking which test to run. By then, however, the most important problem may no longer be the analysis. The study may have collected too few observations, omitted a necessary variable, used an unsuitable measurement schedule, or produced data that cannot answer the original question.

The best time to involve a specialist therefore depends less on when you become stuck and more on when that specialist's expertise could materially improve a decision that will later become difficult or impossible to change.

02 · The Short Answer

Bring in Specialist Expertise Before the Decisions It Could Change Become Irreversible

In Brief

Consult a statistician, methodologist, or other specialist as soon as your study depends on an important decision that exceeds the research team's expertise, especially when that decision affects the design, sample, measurement, data collection, data structure, technical procedure, or analysis plan.

For many projects, this means consultation before data collection rather than after it. Not every question requires an ongoing collaborator, but early targeted advice can prevent problems that no amount of sophisticated analysis can repair later.

03 · What You Need to Know

How to Recognize When Your Study Needs Specialist Expertise

Do not wait until you have a statistical problem

A statistician's role is broader than choosing a test after the dataset has been collected. Statistical considerations can influence the research question, study design, sampling strategy, randomization, sample size, measurement schedule, data structure, data management, analysis plan, interpretation, and reporting.

Recent guidance on collaboration with biostatisticians emphasizes involvement throughout the research process, from study design through interpretation and dissemination. Early involvement can help researchers develop hypotheses, determine sample-size requirements, choose appropriate data structures, and anticipate analytical requirements before data collection begins.

The same principle applies beyond statistics. A qualitative methodologist may identify problems with sampling or interview design before the first participant is recruited. A psychometrician may influence how a construct should be measured. A data scientist may recognize that the proposed data architecture cannot support the intended analysis. A laboratory specialist may identify procedural requirements that affect the entire protocol.

Specialists are most valuable when they can still influence the research rather than merely diagnose what went wrong.

Consult when you are uncertain whether the design can answer the question

If you are unsure whether the proposed methodology actually addresses the research question, consultation should occur early.

This can arise when choosing between experimental and observational approaches, deciding whether repeated measurements are necessary, determining how comparison groups should be constructed, designing a mixed-methods project, planning a complex survey, or working with hierarchical or longitudinal data.

Study-design consultation services at research institutions commonly support exactly these decisions. Research methodologists may advise on design, sample size, measurement, data collection, and analytical strategy before a project begins.

A methodologist is particularly useful when the uncertainty concerns the logic connecting the research question, design, evidence, and inference rather than one isolated statistical technique.

Consult before calculating a consequential sample size you do not understand

Sample-size planning can be deceptively technical.

Simple designs may permit relatively straightforward calculations. More complex studies can require assumptions about expected effects, variability, event rates, clustering, repeated measurements, attrition, allocation ratios, precision, or other design features.

A sample-size calculator can produce a number even when the inputs or underlying model are inappropriate. The resulting precision is mathematical rather than methodological.

If the sample-size requirement materially affects whether the study is feasible and you are uncertain about the assumptions or calculation, seek statistical or methodological input before committing to recruitment targets.

This is particularly important because an inadequate sample may not be repairable after data collection, while an unnecessarily large target can make an otherwise feasible study needlessly expensive or time-consuming.

Consult when the data structure is more complicated than the planned analysis

Some analytical problems are visible before a single observation is collected.

Students nested within classes, patients within hospitals, repeated observations within individuals, matched participants, multiple outcomes, time-to-event data, complex survey designs, spatial data, and linked administrative records all have structures that can affect analysis.

If your current analytical plan ignores those features because you do not know how to handle them, the appropriate response is not necessarily to simplify the dataset. It is to determine what the design requires and whether specialist expertise is needed.

This connects directly to the question of what to do when the appropriate analysis is beyond your current skills. An unfamiliar method is often manageable when recognized early enough for learning or collaboration.

Consult when the analysis could change what data you need to collect

This is one of the clearest signals that specialist involvement should occur before data collection.

Suppose the intended analysis requires baseline measurements, a particular outcome definition, repeated observations, information about clustering, variables needed to address confounding, dates required for survival analysis, or items needed to calculate a scale. If those elements are absent, the analysis may become impossible or substantially weaker.

A statistician or methodologist reviewing the plan before collection can identify such requirements while they can still be added to the protocol.

After data collection, the conversation changes from "What should we measure?" to "What can we salvage from what we measured?" Those are not equivalent positions.

Consult when measurement itself is specialized

Not every specialist problem concerns analysis.

If your study depends on developing or adapting a questionnaire, measuring a latent construct, translating and validating an instrument, constructing a composite scale, calibrating a laboratory measure, or implementing a specialized assessment, appropriate expertise may be needed during measurement design.

A psychometrician, measurement specialist, domain expert, survey methodologist, linguist, laboratory scientist, or other specialist may be more relevant than a statistician depending on the problem.

The central question is: What expertise is necessary for this particular methodological decision?

Do not automatically send every research problem to the statistician. They may be delighted to discover that the problem belongs to someone else.

Consult when the sampling or recruitment problem is methodologically unusual

Sampling can become specialized when populations are rare, hidden, clustered, geographically dispersed, institutionally protected, or difficult to enumerate.

A researcher considering respondent-driven sampling, time-location sampling, complex survey sampling, multistage sampling, adaptive sampling, or another specialized strategy may benefit from expertise before recruitment begins.

The specialist may also help determine whether the proposed sampling method supports the type of population inference the research question implies.

If the problem is primarily that the population is rare or difficult to reach, methodological consultation may need to occur alongside engagement with organizations or communities that understand the population itself.

Consult before building a complex data system

Data-management problems can become methodological problems.

A study collecting repeated observations from multiple sites may require consistent identifiers, linkage rules, validation checks, variable definitions, audit trails, access controls, and procedures for handling corrections. Large observational datasets may require programming, database design, or reproducible workflows that exceed the research team's technical expertise.

Research methods cores at institutions such as Duke explicitly combine expertise in biostatistics, epidemiology, data science, qualitative methods, study design, implementation, and interpretation because these functions often interact.

If the integrity of the eventual analysis depends on how data are structured or processed, involve the relevant data specialist before an improvised spreadsheet becomes the study's unofficial database.

Consult when using unfamiliar secondary or administrative data

Existing datasets can contain analytical complications that are not obvious from the variable list.

Complex survey weights, clustering, repeated measures, linkage, censoring, provider-specific coding, derived variables, missingness, and changes across years can affect the analysis. Registry-based research may similarly require understanding both the clinical or substantive context and the statistical structure of the data.

Collaboration between domain researchers and biostatisticians is particularly valuable in these settings because neither substantive nor statistical expertise alone may be sufficient to interpret the data-generating process correctly.

Before committing to the analysis, make sure you have also evaluated whether the existing dataset is suitable for the proposed study.

Consult when qualitative methodology is unfamiliar or consequential

Research consultation is not synonymous with statistical consultation.

A qualitative methodologist may be useful when choosing among qualitative approaches, developing a sampling strategy, designing interview or focus-group protocols, planning iterative data collection and analysis, addressing reflexivity, developing an analytical process, or deciding how methodological claims should be supported.

Similarly, mixed-methods research may require expertise in how qualitative and quantitative components are sequenced, connected, or integrated rather than simply expertise in each component separately.

Institutional methods cores increasingly recognize this breadth. Duke's Biostatistics, Epidemiology, and Research Design Methods Core, for example, connects investigators with quantitative and qualitative methodologists, data scientists, epidemiologists, and other relevant specialists rather than treating methodological support as statistics alone.

Consult when you cannot explain why your planned method is appropriate

A useful diagnostic question is whether you can explain the proposed method without relying on software labels or phrases copied from another paper.

Why is this design appropriate? Why this sampling strategy? Why this model? What assumptions matter? What information does it estimate? What would make its interpretation misleading?

You do not need to know every technical detail before seeking help. That would rather defeat the purpose of consultation. But if the methodological justification is essentially "other studies used it" or "the software can run it," specialist input may be warranted.

Consult when disagreement among advisers reveals genuine methodological uncertainty

Researchers sometimes receive contradictory advice: one supervisor recommends regression, another structural equation modeling; one reviewer wants a larger sample, another says the design is the real issue; one committee member recommends phenomenology, another suggests grounded theory.

Not every disagreement requires another expert. Research methods often permit more than one defensible approach.

Consultation becomes useful when the disagreement reflects expertise outside the team's competence or when choosing incorrectly would materially affect the validity, feasibility, or interpretation of the study.

A specialist should clarify the methodological trade-offs rather than merely serve as a tie-breaking vote.

Bring specialists in before irreversible decisions

The practical principle can be stated simply: consult before the decision becomes expensive to change.

Research decision Useful time for specialist input What may be too late to repair afterward
Study design While the protocol and research question can still be refined A design incapable of supporting the intended inference
Sample size and sampling Before recruitment targets and procedures are fixed An inadequate sample or inappropriate sampling structure
Measurement Before instruments and data fields are finalized Missing, invalid, or poorly operationalized variables
Data architecture Before data collection systems and identifiers are implemented Unlinkable, inconsistent, or poorly structured records
Statistical analysis Before data collection when analysis affects design, then again during analysis Design features or variables that were never collected
Qualitative analysis During methodological planning and throughout iterative data generation where appropriate Data collection poorly aligned with the analytical approach
Specialized technical procedure Before the protocol depends on the procedure Invalid or irretrievable measurements

Not every specialist needs to become a long-term collaborator

The appropriate level of involvement depends on the problem.

A short consultation may be enough to confirm a straightforward sample-size calculation, review an analysis plan, or identify appropriate methodological resources. More complex projects may require repeated consultation. Highly specialized or methodologically intensive research may benefit from a specialist becoming a formal collaborator throughout the study.

Consultation A specialist provides targeted advice on a defined methodological, analytical, or technical problem while the research team retains responsibility for implementing the work.
Collaboration A specialist contributes substantively across important stages of the project and shares responsibility for relevant research decisions and work.

The boundary is not always sharp, and institutional arrangements vary. What matters is that the level of involvement matches how much the study actually depends on the expertise.

Ask for collaboration when the expertise is central to the study

If a specialist is expected to design substantial parts of the methodology, develop the analysis, write or validate code, interpret complex results, troubleshoot throughout the project, and contribute to reporting, a one-hour consultation may be insufficient.

Long-term methodological partnerships are common in complex research settings. Duke's BERD Methods Core, for example, describes methodologists as forming long-term partnerships with investigators and contributing to design, analysis, methodological implementation, and interpretation.

Plan that involvement explicitly. Determine responsibilities, expected effort, timelines, communication, funding where relevant, and appropriate recognition or authorship according to the specialist's actual contribution and applicable authorship standards.

Do not assume specialist time is immediately available

Expertise is a resource, and resources have capacity limits.

A statistician may have a waiting list. A methods core may prioritize funded projects. A laboratory specialist may be available only during certain periods. A consultant may charge fees. Your institution may provide a limited number of consultation hours.

Research on biostatistical service groups has long recognized that specialist time must be allocated among competing projects. Contemporary institutional methods cores similarly use formal intake and collaboration processes to match projects with available expertise.

If your study cannot proceed without a particular specialist, investigate availability early rather than assuming that help will appear during the week you need it.

Bring something concrete to the consultation

A specialist can help more effectively when the research problem is sufficiently developed to discuss.

Depending on the stage, useful materials may include the research question, study aims, proposed design, target population, variables or measures, sampling plan, expected sample size, data structure, relevant protocol sections, dataset documentation, preliminary data, timeline, and a clear description of what you are uncertain about.

You do not need a finished analysis plan before consulting the person who is supposed to help develop it. You do need enough information for the specialist to understand the scientific problem.

Institutional consultation services commonly ask investigators to describe project aims, design, anticipated completion dates, and the kind of methodological support requested before assigning a collaborator.

Ask a scientific question, not just a software question

"How do I run this in SPSS?" may not be the most important question.

Explain what you are trying to learn from the data, how the data were generated, and what decision or inference the analysis is supposed to support. The specialist can then determine whether the method you had in mind is appropriate at all.

A useful consultation often changes the question from "Which button do I press?" to "What analysis corresponds to the structure of this research problem?"

Do not conceal uncertainty from the specialist

Researchers sometimes arrive at consultation wanting confirmation of a methodology already written into a proposal.

That can limit the value of the conversation.

If you are uncertain about the design, say so. If the sample is constrained, explain the constraint. If a variable is an imperfect proxy, disclose it. If the data have already been collected, make clear which decisions can no longer change.

The specialist needs the actual problem, including its inconvenient parts, to provide useful advice.

Consultation does not transfer responsibility for the research

A statistician or methodologist can provide expertise, but the research team still needs to understand the scientific logic of the study and take responsibility for the resulting work.

You should be able to explain why the method addresses the research question, what the important assumptions and limitations are, and what the results do and do not support. The specialist may have deeper technical expertise, but methodological understanding should not disappear at the boundary between collaborators.

This is particularly important for student research, where demonstrating understanding is usually part of the educational purpose of the project.

AI tools are not a substitute for specialist judgment

AI tools can explain statistical concepts, generate code, suggest analytical strategies, critique questionnaires, and help researchers prepare for consultations. They may reduce the number of routine questions that require specialist time.

They can also recommend inappropriate methods, generate incorrect code, invent assumptions, or provide plausible explanations for analyses that do not fit the design.

If the reason you need a specialist is that nobody on the project can verify a consequential methodological decision, asking an AI system does not remove that problem. It merely introduces another source whose output must itself be evaluated.

Watch Out

Do not postpone specialist consultation because software or AI can generate an analysis. If a methodological decision could affect what data you collect, how many participants you need, how the study is designed, or what conclusions the evidence can support, obtain qualified human expertise before those decisions become irreversible.

Specialist involvement must fit the budget and timeline

Some expertise is available through supervisors, departments, institutional methods cores, libraries, research offices, or collaborative networks. Other support may involve consultation fees, staff effort, specialized software, laboratory services, or formal collaboration.

Include these requirements when assessing feasibility. A method may be technically possible but unrealistic if the only available expert cannot join the project until after your deadline or if the necessary service exceeds the available budget.

This is why the broader question of whether the study is actually feasible should include expertise alongside participants, data, time, money, facilities, and access.

04 · A Practical Example

The Best Time to Consult a Statistician Is Before the Dataset Exists

Hypothetical Example

A student planning a study of AI use and academic outcomes

A doctoral student proposes to examine whether teachers' use of generative AI is associated with student academic outcomes. The study will recruit teachers from several schools and collect outcome data from their students.

The student initially plans to consult a statistician after data collection because the main concern seems to be choosing the correct statistical test.

Recognize the structural issue Students are grouped within teachers and schools, so the observations may not behave as independent cases. The data structure has implications for both design and analysis.
Consult before recruitment A statistician reviews the research question, proposed sampling structure, outcomes, expected number of schools and teachers, repeated measurements, and available covariates.
Change the design while change is still possible The consultation reveals that the number and distribution of clusters matter for the planned analysis. The sampling plan and information recorded about schools and classes are revised before recruitment begins.
Prepare the data structure The research team establishes identifiers that preserve the relationships among students, teachers, classes, and schools rather than trying to reconstruct them after collection.
Continue collaboration during analysis Once the data are available, the statistician helps review the analytical implementation, diagnostics, interpretation, and limitations using a design that was prepared for the analysis from the beginning.

Had the student waited until the dataset was complete, the statistician might still have been able to analyze it. But if essential cluster information, measurements, or an adequate sampling structure had been omitted, no advanced model could recreate them afterward. The early consultation protected the study before the analytical problem became irreversible.

05 · What Researchers Often Get Wrong

Common Mistakes When Seeking Research Specialist Support

Misconception

I only need a statistician after I collect the data

Statistical decisions can affect design, sample size, sampling, measurement, data structure, and the analysis plan. If those features matter to the study, consultation after collection may identify problems that can no longer be repaired.

Misconception

A statistician can fix almost any methodological problem

No analytical technique can reliably manufacture variables that were never measured, increase a completed sample, reconstruct an absent comparison group, or correct every flaw in the original design. Specialists are most useful when they can prevent such problems rather than merely document them afterward.

Misconception

Every methodological problem should go to a statistician

The appropriate specialist depends on the problem. Sampling, measurement, qualitative methodology, psychometrics, survey design, laboratory procedures, data engineering, programming, ethics, domain knowledge, and other areas may require different expertise. Identify the capability the study lacks rather than defaulting automatically to one profession.

Misconception

One consultation is enough for any project

A focused question may need only one meeting. A complex study may require ongoing methodological collaboration from design through interpretation. Match the level of involvement to how central and persistent the specialist expertise is to the project.

Misconception

If a specialist performs the analysis, I do not need to understand it

You may not need the specialist's technical depth, but you should understand how the analysis addresses the research question, its major assumptions and limitations, and what the findings support. Collaboration distributes expertise; it does not eliminate researcher responsibility.

Misconception

I can find specialist help whenever I eventually need it

Specialist time may be limited, scheduled well in advance, restricted to particular projects, or associated with costs. If the study depends on that expertise, verify availability early and include it in the research timeline and resource plan.

06 · What This Means for You

Ask for Help at the Point Where Expertise Can Still Change the Study

Review your research workflow and identify decisions that exceed the competence currently available within the project. Then ask when each decision becomes difficult to reverse.

That date, rather than the moment you finally become stuck, is often the useful deadline for consultation.

A simple decision framework

If you are uncertain whether the proposed design can answer the research question
Consult a relevant methodologist before finalizing the protocol.
If statistical assumptions affect sample size, sampling, measurement, timing, or data structure
Consult a statistician or quantitative methodologist before data collection begins.
If the study requires unfamiliar qualitative, measurement, survey, technical, laboratory, computational, or data-management expertise
Identify the specialist whose expertise matches the actual problem and involve that person before the relevant procedure is fixed.
If you understand the method but need limited verification of one technical decision
A focused consultation may be sufficient rather than adding a long-term collaborator.
If specialist expertise is central across design, implementation, analysis, and interpretation
Plan for substantive collaboration rather than treating the specialist as an emergency consultant at the end.
If no appropriate specialist is realistically available within the project's timeline or resources
Reconsider the design or research question rather than proceeding with a critical methodological gap.

The purpose of consultation is not to make a study look more sophisticated. It is to obtain expertise at the point where it can protect the validity and feasibility of the research. Sometimes that requires one conversation. Sometimes it requires another researcher at the table from the beginning.

07 · A Quick Checklist

Do You Need a Statistician, Methodologist, or Other Specialist?

Before finalizing the methodology, check:
Identify the methodological, statistical, qualitative, measurement, technical, computational, or data-management decisions that exceed the expertise currently available within the research team.
Ask whether specialist input could change the study design, sample size, sampling strategy, measurement, data structure, or data collection before those decisions become irreversible.
Seek statistical input before data collection when the planned analysis has implications for what observations, variables, clusters, time points, or sample structure must be collected.
Choose the specialist according to the actual expertise required rather than assuming every methodological problem belongs to a statistician.
Determine whether the project needs one targeted consultation, periodic advice, or substantive collaboration throughout several research stages.
Confirm that the specialist is genuinely available within the project's timeline and identify any fees, institutional procedures, or resource requirements.
Prepare the research question, aims, proposed design, population, measures, data structure, timeline, and specific uncertainties before the consultation.
Explain the scientific problem rather than asking only how to operate particular software or run a predetermined technique.
Clarify responsibilities when specialist involvement becomes substantial, including expected contributions, communication, deliverables, and appropriate recognition.
Redesign the study if essential expertise cannot realistically be learned or obtained before the relevant methodological decisions must be made.
08 · Frequently Asked Questions

Frequently Asked Questions About Research Specialist Consultation

When should I consult a statistician for my research?

Consult before data collection when statistical considerations could affect the study design, sample size, sampling, measurements, repeated observations, clustering, data structure, or analysis plan. Consultation during analysis and interpretation may also be valuable, but early involvement can prevent problems that cannot be corrected afterward.

Should I consult a statistician before calculating my sample size?

Seek statistical input when the calculation involves assumptions or design features you do not understand, particularly when the result will determine recruitment, cost, or feasibility. Straightforward calculations may not require specialist involvement, but complex designs involving clustering, repeated measurements, survival outcomes, multiple groups, or other specialized features often benefit from it.

What is the difference between a statistician and a research methodologist?

The roles can overlap. A statistician or biostatistician specializes in statistical design, analysis, and inference, while a research methodologist may work more broadly across research design, sampling, measurement, data collection, qualitative or quantitative methodology, and the alignment between research questions and methods. Actual expertise varies by individual, so choose according to the problem rather than the job title alone.

When do I need a specialist other than a statistician?

When the critical problem concerns another area of expertise. Examples include qualitative methodology, psychometrics, survey methodology, data engineering, programming, bioinformatics, laboratory procedures, geospatial analysis, information security, translation, or specialized domain knowledge. Complex projects may require several kinds of expertise.

What should I prepare before meeting a statistician or methodologist?

Bring a clear research question or aims, the proposed design, target population, sampling plan, measures or variables, expected data structure, available sample information, relevant dataset or protocol documentation, timeline, and the decisions you are uncertain about. If data already exist, explain how they were collected and what can no longer be changed.

Do I need a statistician as a coauthor?

Not automatically. Authorship should reflect the person's actual scholarly contribution and the authorship criteria applicable to the work, not simply their professional title. A brief consultation may not warrant authorship, while substantial contributions to design, analysis, interpretation, and manuscript development may. Discuss expectations early when specialist involvement is likely to become substantial.

Can I wait until I have collected my data before asking for statistical help?

You can seek help then, and statistical consultation may still improve the analysis. The risk is that important design, sampling, measurement, or data-structure problems may already be irreversible. If you are uncertain about any of those issues, earlier consultation is preferable.

What if I cannot find or afford the specialist my study requires?

Check whether expertise is available through your supervisor, department, university methods core, statistics or data-science unit, library, research office, collaborators, or other institutional resources. If essential expertise still cannot be obtained within the project's time and budget, reconsider the design or question rather than proceeding with a critical unsupported component.

09 · The Bottom Line

Ask for Expertise Before You Need It to Repair Something

The Bottom Line

Bring in a statistician, methodologist, or other specialist before an important decision outside your expertise becomes difficult or impossible to change, especially when it affects study design, sampling, sample size, measurement, data structure, technical procedures, or analysis.

Not every study needs a permanent methodological collaborator, and not every technical question requires specialist intervention. Match the expertise and level of involvement to the actual problem. When the specialist could change what evidence you collect or how you collect it, however, the safest time to consult is usually before the dataset exists rather than after you discover what it cannot do.

10 · Sources and Further Reading

Sources and Further Reading

11 · Cite this Guide

How to Cite This Guide

This guide is intended to be read, shared, and used in research, teaching, and academic work. If you draw on its ideas, explanations, or other content, please acknowledge the source by citing the guide. Doing so gives appropriate credit and helps your readers locate the original resource.

Has the Field Guide helped your research?

If a guide helped clarify a question, inform a research decision, or move your work forward, I would love to hear about your experience. Your story may also help other researchers discover the Field Guide.

Share Your Experience
Takes only a few minutes