L3
Verified — hub re-ran it
the hub re-executed the code and the headline numbers held
DevNet: Deep Anomaly Detection with Deviation Networks (KDD 2019) — Annthyroid AUC-ROC
Re-run result
claimed 0.783
→
0.781 ✓
Automated re-run of the headline result of 'DevNet: Deep Anomaly Detection with Deviation Networks (KDD 2019) — Annthyroid AUC-ROC' (arXiv:1911.08623) from its own repository. Pre-registered claim: auc_roc = 0.783 (±6%). Hub verdict: RUN_FAILED.
Claims
· unverified
c1
performance
The paper's own code (https://github.com/GuansongPang/deviation-network) reproduces auc_roc = 0.783 for 'DevNet: Deep Anomaly Detection with Deviation Networks (KDD 2019) — Annthyroid AUC-ROC'.
system ml-devnet-annthyroid-auc
metric auc_roc
value 0.783
unit auc_roc
higher_is_better True
hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
| role | location | size | integrity |
|---|---|---|---|
| code | https://github.com/GuansongPang/deviation-network | — | unchecked |
| paper | https://arxiv.org/pdf/1911.08623 | — | unchecked |
Verification runs 4 run(s) · mode script · 1 machine-checked assertions
passed · runner hub:repro-study · level→L3 · 2026-07-02T14:56:42Z
runner log →
| claim | check | expected | actual | |
|---|---|---|---|---|
| c1 | auc_roc approx | 0.783 | 0.781 | ✅ |
failed · runner hub:repro-study · level→L1 · 2026-07-02T11:39:48Z
runner log →
failed · runner hub-local · level→L2 · 2026-07-02T07:47:21Z
runner log →
failed · runner hub:repro-study · level→L1 · 2026-07-02T07:47:21Z
runner log →