L3
Verified — hub re-ran it
the hub re-executed the code and the headline numbers held
PIDForest: Anomaly Detection via Partial Identification — Satimage-2 ROC-AUC
Re-run result
claimed 0.982
→
0.9786 ✓
Automated re-run of the headline result of 'PIDForest: Anomaly Detection via Partial Identification — Satimage-2 ROC-AUC' (arXiv:1912.03582) from its own repository. Pre-registered claim: roc_auc = 0.982 (±6%). Hub verdict: RUN_FAILED.
Claims
· unverified
c1
performance
The paper's own code (https://github.com/vatsalsharan/pidforest) reproduces roc_auc = 0.982 for 'PIDForest: Anomaly Detection via Partial Identification — Satimage-2 ROC-AUC'.
system ml-pidforest-satimage2-auc
metric roc_auc
value 0.982
unit roc_auc
higher_is_better True
hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
| role | location | size | integrity |
|---|---|---|---|
| code | https://github.com/vatsalsharan/pidforest | — | unchecked |
| paper | https://arxiv.org/pdf/1912.03582 | — | unchecked |
Verification runs 3 run(s) · mode script · 1 machine-checked assertions
passed · runner hub:repro-study · level→L3 · 2026-07-02T11:39:48Z
runner log →
| claim | check | expected | actual | |
|---|---|---|---|---|
| c1 | roc_auc approx | 0.982 | 0.9786 | ✅ |
failed · runner hub-local · level→L2 · 2026-07-02T07:47:21Z
runner log →
failed · runner hub:repro-study · level→L1 · 2026-07-02T07:47:21Z
runner log →