1. Background — Sampling Distribution of
Theorem — Distribution of the Sample Variance
If is the variance of a random sample of size from a normal population with variance , then
and and are independent.
Idea of the proof. (sum of squared standard normals). The identity
splits it into two independent pieces; the last is , so by MGFs , giving , i.e. . One degree of freedom is “used up” by estimating with .
Worked Example
A process has . For a sample of , find :
(Table: for , so the probability is just under 0.10.)
⚠️ This result needs a normal population; it is sensitive to non-normality (unlike results for , which the CLT protects).
2. The t-Distribution
Definition — Student’s t-Distribution
If and are independent, then
has the t-distribution with degrees of freedom, with density
Theorem — The t Statistic
For a random sample from a normal population with mean ,
Proof. Write
with , , independent by Section 1. The unknown cancels.
Properties
| Property | t-distribution |
|---|---|
| Shape | bell-shaped, symmetric about 0 |
| Mean | 0 (for ) |
| Variance | (for ) — heavier tails than |
| As |
Notation — Critical Values
is the value with area to its right. By symmetry .
| 1.761 | 1.714 | 1.711 | 1.645 | |
| 2.145 | 2.069 | 2.064 | 1.960 |
Worked Example
A supplier claims mean fiber strength . A sample of gives , (population assumed normal).
From the table, , so (exact: ). A sample mean this high would be unusual if were really 500.
⚠️ Use (not ) when is unknown and replaced by . For large the two are almost identical.
3. The F-Distribution
Definition — F-Distribution
If and are independent, then
has the F-distribution with (numerator) and (denominator) degrees of freedom. It is positive and right-skewed.
Theorem — Ratio of Two Sample Variances
For independent samples of sizes , from normal populations with variances :
Proof. independently; divide each by its degrees of freedom and take the ratio.
Theorem — Reciprocal Property
Proof. If then . So , i.e. , which says .
Worked Example — Table Lookups
⚠️ Order of degrees of freedom matters: and are different distributions. Numerator df first.
Worked Example — Comparing Variances
Two machines are believed to have equal variances. Samples , . If , then and
So an observed ratio of 3.1 would cast doubt on equal variances.
The F-distribution is used to compare two variances and in analysis of variance (ANOVA).
4. Quantile and Probability Plots
Definition — Quantile
A quantile of a sample is a value such that a fraction of the data is . For sorted data , is taken as with
(other conventions, e.g. , are also common).
Definition — Quantile Plot
Plot of against . It shows the shape of the data (flat stretches = clusters, steep jumps = gaps/outliers).
Definition — Normal Quantile–Quantile (Q–Q) Plot
Plot the sorted data against the standard normal quantiles .
- If the data come from a normal distribution, the points lie close to a straight line.
- The line’s intercept ≈ and slope ≈ .
| Pattern on the normal Q–Q plot | Meaning |
|---|---|
| Points on a straight line | approximately normal |
| Curve bending upward at the right (convex) | right-skewed |
| Curve bending downward at the right (concave) | left-skewed |
| S-shape, both ends flare away | heavy tails |
| Isolated point far off the line | outlier |
Worked Example
Ten measurements (sorted): .
| 1 | 4.4 | 0.061 | −1.547 |
| 2 | 4.7 | 0.159 | −1.000 |
| 3 | 4.9 | 0.256 | −0.655 |
| 4 | 5.1 | 0.354 | −0.375 |
| 5 | 5.3 | 0.451 | −0.123 |
| 6 | 5.5 | 0.549 | 0.123 |
| 7 | 5.6 | 0.646 | 0.375 |
| 8 | 5.8 | 0.744 | 0.655 |
| 9 | 6.0 | 0.841 | 1.000 |
| 10 | 6.2 | 0.939 | 1.547 |
The points lie close to a line with intercept () and slope (compare ), so a normal model is reasonable — which justifies using procedures on these data.
⚠️ With small , Q–Q plots wiggle even for truly normal data; look for systematic curvature, not small bumps.