L3
Verified — hub re-ran it
the hub re-executed the code and the headline numbers held
Darts ExponentialSmoothing — AirPassengers validation MAPE (quickstart claim)
Re-run result
claimed 5.11
→
5.11 ✓
Automated re-run of the headline result of 'Darts ExponentialSmoothing — AirPassengers validation MAPE (quickstart claim)' (arXiv:2110.03224) from its own repository. Pre-registered claim: mape_airpassengers_val = 5.11 (±30%). Hub verdict: TIMEOUT.
Claims
· unverified
c1
performance
The paper's own code (https://github.com/unit8co/darts) reproduces mape_airpassengers_val = 5.11 for 'Darts ExponentialSmoothing — AirPassengers validation MAPE (quickstart claim)'.
system ts-darts-airpassengers
metric mape_airpassengers_val
value 5.11
unit mape_airpassengers_val
higher_is_better True
hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
| role | location | size | integrity |
|---|---|---|---|
| code | https://github.com/unit8co/darts | — | unchecked |
| paper | https://arxiv.org/pdf/2110.03224 | — | unchecked |
Verification runs 3 run(s) · mode script · 1 machine-checked assertions
passed · runner hub:repro-study · level→L3 · 2026-07-02T11:39:48Z
runner log →
| claim | check | expected | actual | |
|---|---|---|---|---|
| c1 | mape_airpassengers_val approx | 5.11 | 5.11 | ✅ |
failed · runner hub-local · level→L2 · 2026-07-02T07:47:22Z
runner log →
timeout · runner hub:repro-study · level→L2 · 2026-07-02T07:47:22Z
runner log →