Mathematics I / Numerical Errors and Stability
Practice question · Multiple choice

Subtracting two nearly equal numbers is called catastrophic cancellation. Why is it so much worse than other floating-point operations?

Hints
  1. Take 1.00000001 and 1.00000000, each accurate to 8 significant figures. How many are left in the difference?
  2. Ask what happens to the ABSOLUTE error and to the RELATIVE error.
Show the answer

A. Because the leading digits cancel and the errors do not

Why

The absolute error is unchanged and the result is tiny, so the relative error explodes, accurate inputs give an answer that is mostly noise. It is why the quadratic formula is rearranged when b² ≫ 4ac, and why numerical analysts rewrite algebra that looks perfectly fine on paper.

Read the lesson: Numerical Errors and Stability →

Practise Numerical Errors and Stability

The app has 5 more questions on this lesson, and keeps your place in the course. Mathematics I is free to start.

More questions on Numerical Errors and Stability