01 · The Question
What Exactly Are the Null and Alternative Hypotheses?
You formulate a research hypothesis, collect your data, and reach the statistical analysis. Suddenly, two new statements appear: the null hypothesis, usually written as H0, and the alternative hypothesis, commonly written as H1 or Ha.
If your substantive expectation is that an intervention improves performance, why does the statistical procedure begin by considering a hypothesis of no improvement? And if you reject the null hypothesis, have you proved the alternative hypothesis?
The confusion often comes from treating null and alternative hypotheses as ordinary competing guesses. In classical statistical hypothesis testing, they have specific mathematical and inferential roles. Understanding those roles also helps prevent one of the most persistent errors in research reporting: interpreting failure to reject the null hypothesis as proof that nothing is happening.
03 · What You Need to Know
How H0 and H1 Work in Statistical Hypothesis Testing
What Is the Null Hypothesis?
The null hypothesis specifies a particular claim about a population parameter or data-generating process against which the evidence is evaluated. In many familiar research applications, it represents no difference, no association, or no effect.
Suppose you compare mean examination scores between students receiving a new instructional intervention and students receiving conventional instruction. A simple null hypothesis might be expressed as:
H0: μintervention = μcomparison
Equivalently:
H0: μintervention − μcomparison = 0
Here, the null specifies that the population mean difference is zero.
However, "no effect" is not the universal definition of a null hypothesis. Depending on the statistical question, H0 can specify another parameter value, a boundary, or a composite set of values. What matters is that it defines the condition against which the statistical test is constructed.
What Is the Alternative Hypothesis?
The alternative hypothesis specifies the competing parameter values or condition of interest. In a two-sided comparison of two means, it might be:
H1: μintervention ≠ μcomparison
This says that the population means differ, without specifying which one is larger.
If there is a justified directional prediction, the alternative could instead take a one-sided form:
H1: μintervention > μcomparison
That distinction matters because the alternative hypothesis helps determine whether the statistical test is one-sided or two-sided. The direction should be established from the research rationale rather than chosen after observing which way the sample results happen to point.
Null and Alternative Hypotheses at a Glance
| Feature |
Null hypothesis |
Alternative hypothesis |
| Common notation |
H0
|
H1 or Ha
|
| Statistical role |
Specifies the condition evaluated by the test |
Specifies the competing possibility |
| Typical two-group example |
No population mean difference |
A population mean difference exists |
| Typical notation |
μ1 = μ2
|
μ1 ≠ μ2, μ1 > μ2, or μ1 < μ2
|
| Decision in conventional significance testing |
Reject or fail to reject |
Not ordinarily "proved" by the test |
Why Does Statistical Testing Begin With H0?
Classical significance testing asks how compatible the observed data, or something more extreme according to the test statistic, would be with a specified null model. A test statistic summarizes the discrepancy between the observations and what would be expected under H0.
The p-value is then calculated under the assumption that the null hypothesis and the statistical model used for the test hold. Informally, it asks how unusual the observed test statistic, or one at least as extreme, would be under those assumptions.
If the p-value meets the prespecified significance criterion, researchers may reject H0. If it does not, they fail to reject H0.
This framework explains why statistical testing requires clearly specified competing hypotheses. NIST, for example, describes a statistical test as a mechanism for making quantitative decisions about a conjecture and notes that a statistical test requires null and alternative hypotheses.
Rejecting H0 Does Not Mean H0 Had Zero Probability of Being True
A p-value is not the probability that H0 is true. Conventional frequentist significance testing does not calculate P(H0 | data), the probability of the hypothesis given the observed data.
Instead, the calculation proceeds in the other direction: assuming H0 and the relevant statistical assumptions, how unusual would the observed result or a more extreme one be?
This distinction is easy to reverse in ordinary language, but the two probabilities are not equivalent.
What Does Rejecting the Null Hypothesis Mean?
Suppose you set α =.05 before conducting the analysis and obtain a p-value of.012. Under the conventional decision rule, you would reject H0 at the.05 significance level.
This means the observed evidence meets the criterion established for rejecting that null hypothesis under the statistical model. It does not establish that the alternative hypothesis is certainly true, that the effect is large, that the study is free from bias, or that the result will replicate.
Statistical significance addresses a narrower question than scientific importance.
What Does Failing to Reject H0 Mean?
Suppose instead that p =.18. Under a conventional α =.05 criterion, you fail to reject H0.
The careful wording is fail to reject, not accept.
A nonsignificant result can occur because the null hypothesis is compatible with the data, but it can also occur when the study provides insufficient precision or statistical power to distinguish a meaningful effect from sampling variability. Measurement problems, small samples, heterogeneous effects, and model assumptions can also influence the result.
Watch Out
"The result was not statistically significant" does not automatically justify "there is no effect." If establishing practical equivalence or ruling out effects beyond a meaningful margin is the goal, methods specifically designed for those questions may be more appropriate than interpreting an ordinary nonsignificant test as evidence of equality.
The Research Hypothesis and Statistical Alternative Are Related but Not Identical
Researchers sometimes use "alternative hypothesis" and "research hypothesis" interchangeably. They often correspond, but the concepts operate at different levels.
A research hypothesis is a substantive prediction about the phenomenon under investigation:
Students receiving retrieval practice will retain more material than students who reread the material.
A statistical alternative translates the relevant part of that substantive prediction into a statement about population parameters:
H1: μretrieval > μrereading
Keeping those levels distinct helps explain why statistical and research hypotheses are not simply the same thing written differently.
Null and Alternative Hypotheses Must Fit Together
The hypotheses should define the relevant possibilities coherently. For a two-sided comparison of a population mean with a reference value μ0, a familiar pair is:
H0: μ = μ0
H1: μ ≠ μ0
For a one-sided test, the hypotheses are formulated so that the null includes values outside the direction represented by the alternative. For example:
H0: μ ≤ μ0
H1: μ > μ0
The exact formulation depends on the parameter and test being used. This is why statistical hypotheses should not be written as decorative sentences disconnected from the planned analysis.
Directional Alternatives Change the Statistical Question
An alternative hypothesis stating μ1 ≠ μ2 asks whether the population means differ in either direction. An alternative stating μ1 > μ2 asks a narrower directional question.
That choice affects the rejection region in conventional hypothesis testing. It should therefore be determined before looking at the results and justified by the substantive research question. The underlying decision is closely connected to choosing between directional and nondirectional hypotheses.
Statistical Significance Is Not the Whole Scientific Conclusion
Even a correctly specified hypothesis test does not tell you everything you need to know. Researchers should also examine the estimated effect, its uncertainty, the quality of measurement, study design, assumptions, possible biases, substantive plausibility, and practical importance.
A tiny effect can be statistically detectable in a sufficiently large dataset. Conversely, a potentially important effect can remain statistically uncertain in a small or noisy study.
H0 and H1 therefore structure a statistical decision. They do not replace scientific interpretation.