L2
Environment builds
the environment builds and runs; numbers not yet re-checked
UMAP: Uniform Manifold Approximation and Projection — MNIST 70k embedding runtime
Automated re-run of the headline result of 'UMAP: Uniform Manifold Approximation and Projection — MNIST 70k embedding runtime' (arXiv:1802.03426) from its own repository. Pre-registered claim: embedding_runtime_seconds = 42 (±100%). Hub verdict: DIVERGED.
Claims
· unverified
c1
performance
The paper's own code (https://github.com/lmcinnes/umap) reproduces embedding_runtime_seconds = 42 for 'UMAP: Uniform Manifold Approximation and Projection — MNIST 70k embedding runtime'.
system umap-mnist-runtime
metric embedding_runtime_seconds
value 42
unit embedding_runtime_seconds
higher_is_better True
hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
| role | location | size | integrity |
|---|---|---|---|
| code | https://github.com/lmcinnes/umap | — | unchecked |
| paper | https://arxiv.org/pdf/1802.03426 | — | unchecked |
Verification runs 2 run(s) · mode script · 1 machine-checked assertions
failed · runner hub-local · level→L2 · 2026-07-02T07:47:22Z
runner log →
failed · runner hub:repro-study · level→L2 · 2026-07-02T07:47:22Z
runner log →
| claim | check | expected | actual | |
|---|---|---|---|---|
| c1 | embedding_runtime_seconds approx | 42.0 | 129.54 | ❌ |