L2
Environment builds
the environment builds and runs; numbers not yet re-checked
N-BEATS — M4 Yearly ensemble sMAPE (author repo; GPU/long-train probe)
Automated re-run of the headline result of 'N-BEATS — M4 Yearly ensemble sMAPE (author repo; GPU/long-train probe)' (arXiv:1905.10437) from its own repository. Pre-registered claim: smape_m4_yearly = 13.114 (±5%). Hub verdict: TIMEOUT.
Claims
· unverified
c1
performance
The paper's own code (https://github.com/ServiceNow/N-BEATS) reproduces smape_m4_yearly = 13.114 for 'N-BEATS — M4 Yearly ensemble sMAPE (author repo; GPU/long-train probe)'.
system ts-nbeats-m4
metric smape_m4_yearly
value 13.114
unit smape_m4_yearly
higher_is_better True
hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
| role | location | size | integrity |
|---|---|---|---|
| code | https://github.com/ServiceNow/N-BEATS | — | unchecked |
| paper | https://arxiv.org/pdf/1905.10437 | — | unchecked |
Verification runs 2 run(s) · mode script · 1 machine-checked assertions
failed · runner hub-local · level→L2 · 2026-07-02T07:47:22Z
runner log →
timeout · runner hub:repro-study · level→L2 · 2026-07-02T07:47:22Z
runner log →