L3
Verified — hub re-ran it
the hub re-executed the code and the headline numbers held
XGBoost: A Scalable Tree Boosting System — HIGGS test AUC
Re-run result
claimed 0.84
→
0.8243 ✓
Automated re-run of the headline result of 'XGBoost: A Scalable Tree Boosting System — HIGGS test AUC' (arXiv:1603.02754) from its own repository. Pre-registered claim: auc = 0.84 (±5%). Hub verdict: RUN_FAILED.
Claims
· unverified
c1
performance
The paper's own code (https://github.com/dmlc/xgboost) reproduces auc = 0.84 for 'XGBoost: A Scalable Tree Boosting System — HIGGS test AUC'.
system xgboost-higgs-auc
metric auc
value 0.84
unit auc
higher_is_better True
hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
| role | location | size | integrity |
|---|---|---|---|
| code | https://github.com/dmlc/xgboost | — | unchecked |
| paper | https://arxiv.org/pdf/1603.02754 | — | unchecked |
Verification runs 4 run(s) · mode script · 1 machine-checked assertions
passed · runner hub:repro-study · level→L3 · 2026-07-02T11:58:41Z
runner log →
| claim | check | expected | actual | |
|---|---|---|---|---|
| c1 | auc approx | 0.84 | 0.8243 | ✅ |
failed · runner hub:repro-study · level→L1 · 2026-07-02T11:39:48Z
runner log →
failed · runner hub-local · level→L2 · 2026-07-02T07:47:22Z
runner log →
failed · runner hub:repro-study · level→L1 · 2026-07-02T07:47:22Z
runner log →