L3
Verified — hub re-ran it
the hub re-executed the code and the headline numbers held
DeepWalk: Online Learning of Social Representations — BlogCatalog Micro-F1 (50% labeled)
Re-run result
claimed 0.4151
→
0.4117319988879622 ✓
Automated re-run of the headline result of 'DeepWalk: Online Learning of Social Representations — BlogCatalog Micro-F1 (50% labeled)' (arXiv:1403.6652) from its own repository. Pre-registered claim: blogcatalog_micro_f1_50pct = 0.4151 (±10%). Hub verdict: RUN_FAILED.
Claims
· unverified
c1
performance
The paper's own code (https://github.com/phanein/deepwalk) reproduces blogcatalog_micro_f1_50pct = 0.4151 for 'DeepWalk: Online Learning of Social Representations — BlogCatalog Micro-F1 (50% labeled)'.
system graph-deepwalk-blogcatalog-microf1
metric blogcatalog_micro_f1_50pct
value 0.4151
unit blogcatalog_micro_f1_50pct
higher_is_better True
hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
| role | location | size | integrity |
|---|---|---|---|
| code | https://github.com/phanein/deepwalk | — | unchecked |
| paper | https://arxiv.org/pdf/1403.6652 | — | unchecked |
Verification runs 4 run(s) · mode script · 1 machine-checked assertions
passed · runner hub:repro-study · level→L3 · 2026-07-02T14:21:34Z
runner log →
| claim | check | expected | actual | |
|---|---|---|---|---|
| c1 | blogcatalog_micro_f1_50pct approx | 0.4151 | 0.4117319988879622 | ✅ |
failed · runner hub:repro-study · level→L1 · 2026-07-02T11:39:48Z
runner log →
failed · runner hub-local · level→L2 · 2026-07-02T07:47:20Z
runner log →
failed · runner hub:repro-study · level→L1 · 2026-07-02T07:47:20Z
runner log →