Courses / Mathematics I
Scientific Programming

Numerical Errors and Stability

Mathematics I 226 words Free to read

Sources and Trade-offs

Every numerical computation carries error. Two fundamental kinds arise:

These often trade off. Making a step size hh smaller reduces truncation error but can increase round-off error by subtracting nearly equal numbers.

Error TypeOriginExample
Round-offFinite precisionFloating-point limits
TruncationFinite approximationStopping a series early

Common pitfall: Assuming a smaller step size hh always improves accuracy. Shrinking hh eventually increases round-off error, so accuracy peaks at an optimal step size.

Two errors pull step size in opposite directions; the sum has a floor

Stability and Propagation

Errors propagate through computations. Two major dangers include catastrophic cancellation, where subtracting nearly equal numbers destroys significant digits, and error amplification from unstable calculations.

Two mathematically equivalent formulas can differ enormously in stability; choosing the stable one is a core skill.

Practise this lesson

The explanation above is free to read. The graded practice for this lesson lives in the Tryals app.

11practice questions
2interactive scenes

Scientific Programming