Practice question · Select all that apply
A colleague sends a script and the number it printed. Select everything you still need before that result can be called reproducible.
Hints
- Reproducibility means obtaining the same number again, not obtaining it faster.
- Three of these can change the output; two cannot.
Show the answer
- A. The exact version of the code that produced it
- B. The random seed that was used
- C. The library versions it ran against
Why
Code version, seed and environment are exactly the three things that can change the number. Speed and optimality are worth caring about for other reasons, but neither affects whether the result can be reproduced.
Practise Reproducibility and Good Practice
The app has 5 more questions on this lesson, and keeps your place in the course. Mathematics I is free to start.
More questions on Reproducibility and Good Practice
- A NumPy vectorised operation and an equivalent Python loop compute identical results, and the vectorised one…
- Vectorising usually gives a large speed-up, but sometimes almost none. Why does replacing a loop with an…
- Two runs of the same simulation with the same fixed seed and the same library versions should produce…
- Sort each practice by its effect on reproducibility.
- Complete the purpose of a test suite.
- A test suite contains 40 unit tests, of which 36 passed before a change. The change makes 3 previously…
- Order the steps of putting an analysis on a reproducible footing.