1. The Gamma Function
Definition — Gamma Function
Theorem — Properties
- for
- for positive integers ;
Proof of 1. Integrate by parts with , :
Property 2 follows by repeating 1 down to . For 3, substitute and use the normal integral .
2. Gamma Distribution
Definition — Gamma Distribution
= shape, = scale.
Theorem — Mean and Variance
Proof (mean). Substituting :
Similarly , so .
Theorem — Gamma–Poisson Relationship
In a Poisson process with rate , the waiting time until the -th event ( an integer) is Gamma with shape and scale .
Proof. iff fewer than events occur in :
Differentiating in gives the gamma density with .
Worked Example
Calls arrive at a switchboard at per minute. Probability that the 3rd call comes within 1 minute (, ):
Mean waiting time min, variance .
⚠️ Some books use a rate parameter instead of the scale . Check the density before plugging in.
3. Exponential Distribution
Definition — Exponential Distribution
Gamma with :
It models the time between events of a Poisson process (with ) and lifetimes of components that do not wear out.
Theorem — Memoryless Property
Proof. .
The exponential is the only continuous distribution with this property (the geometric is the discrete analogue).
Worked Example
An LED driver has lifetime .
- Given it has already run 600 h, — the same!
- Median lifetime: h (less than the mean, since the distribution is right-skewed)
⚠️ Memorylessness means “a used component is as good as new” — fine for random shocks, wrong for parts that wear out (use Weibull with there).
4. Chi-Squared Distribution
Definition — Chi-Squared Distribution
Gamma with , :
(a positive integer) is the degrees of freedom.
Theorem — Origin of
If are independent , then
(proved with moment-generating functions in Chapter 9).
Notation — Critical Values
is the value with area to its right: .
Example. With : and . So .
⚠️ is not symmetric: you cannot get the left critical value by changing sign; look up both tails.
is used for inference about a variance (Chapter 10) and for goodness-of-fit and independence tests (Chapter 14).
5. Beta Distribution
Definition — Beta Distribution
Models proportions and probabilities (fraction of time a server is busy, a proportion defective). .
Worked Example
The fraction of CPU time used by a background task is : .
, .
6. Lognormal Distribution
Definition — Lognormal Distribution
is lognormal if :
Theorem — Probabilities via the Normal Table
Worked Example
Repair times (hours) are lognormal with , .
Median h; mean h.
⚠️ and are the mean and SD of , not of .
7. Weibull Distribution
Definition — Weibull Distribution
With it reduces to the exponential.
Definition — Reliability and Failure Rate
- Reliability:
- Failure (hazard) rate:
| Failure rate | Interpretation | |
|---|---|---|
| decreasing | ”infant mortality” (early defects) | |
| constant | random failures (exponential) | |
| increasing | wear-out / aging |
Worked Example
Bearing life (in 1000 h) is Weibull with , .
- (thousand hours)
- Failure rate at : — increasing, so the bearing wears out.
Summary Table
| Distribution | Support | Mean | Variance | Typical use |
|---|---|---|---|---|
| Gamma | waiting time to -th event | |||
| Exponential | time between events, memoryless lifetimes | |||
| sums of squared normals; variance tests | ||||
| Beta | proportions | |||
| Lognormal | skewed positive data, repair times | |||
| Weibull | see above | reliability, failure times |