1. Nonlinear Models
| Model | Equation |
|---|---|
| Exponential | |
| Power | |
| Saturation growth | |
| Polynomial |
The criterion is still least squares: minimize .
2. Polynomial Regression
Setup
Given points, fit with .
⚠️ With the polynomial would pass through every point, which is interpolation, not regression. Hence .
Derivation
For each :
Theorem – Normal equations ( system)
Entry is (rows/columns indexed from 0). Solve with Chapter 1’s methods.
Example (slides) – thermal expansion coefficient, 2nd order
Fit :
| (°F) | 80 | 40 | −40 | −120 | −200 | −280 | −340 |
|---|---|---|---|---|---|---|---|
| (×10⁻⁶ in/in/°F) | 6.47 | 6.24 | 5.72 | 5.09 | 4.30 | 3.33 | 2.45 |
Sums ():
⚠️ Slide typo: the first right-hand-side entry is printed as ; it’s .
⚠️ The matrix entries range from to , so the system is badly scaled. Keep full precision (a refit from the raw data gives , , ; the small differences come from rounding the sums).
3. Exponential Model – Direct Least Squares
Derivation
Rewritten:
Theorem – Solving for and
From the first equation:
Substituting into the second gives one nonlinear equation in :
Solve it numerically, e.g. by bisection (2.1), then compute .
Example (slides) – Technetium-99m radiation
(half of Tc-99m is gone in ≈ 6 h):
| (h) | 0 | 1 | 3 | 5 | 7 | 9 |
|---|---|---|---|---|---|---|
| 1.000 | 0.891 | 0.708 | 0.562 | 0.447 | 0.355 |
Numerical solution (MATLAB on the slides; bisection on gives the same):
4. Transformation of Data (Linearization)
Method
Most nonlinear models lead to simultaneous nonlinear equations. Transforming the data turns them into a linear regression (4.1). For the exponential:
Let , , → (linear):
Other linearizations (extra)
| Model | Transform | Linear form | Back to model |
|---|---|---|---|
| , | |||
| , | , | ||
| , | , |
Example (slides) – Tc-99m again, by transformation
| 1 | 0 | 1 | 0.00000 | 0.00000 | 0 |
| 2 | 1 | 0.891 | −0.11541 | −0.11541 | 1 |
| 3 | 3 | 0.708 | −0.34531 | −1.0359 | 9 |
| 4 | 5 | 0.562 | −0.57625 | −2.8813 | 25 |
| 5 | 7 | 0.447 | −0.80520 | −5.6364 | 49 |
| 6 | 9 | 0.355 | −1.0356 | −9.3207 | 81 |
| 25 | −2.8778 | −18.990 | 165 |
Half-life check (extra): h, consistent with “about 6 hours”.
⚠️ The transformed fit minimizes , not , so its constants differ slightly from the direct method ( vs , vs ).
⚠️ Slide typo: row 6 of the table lists ; it’s (consistent with and ).