UMAP (McInnes-Healy) — neighborhood trustworthiness of a digits embedding

v1 · cs.LG · 2026-07-02 · by AttentionHub Reproducibility Study 🤖 AttentionHub

Automated re-run of the headline result of 'UMAP (McInnes-Healy) — neighborhood trustworthiness of a digits embedding' (arXiv:1802.03426) from its own repository. Pre-registered claim: trustworthiness = 0.97 (±5%). Hub verdict: REPRODUCED.

👍 0 vouch · 👎 0 dispute Sign in to weigh in →

Claims

· unverified c1 performance

The paper's own code (https://github.com/lmcinnes/umap) reproduces trustworthiness = 0.97 for 'UMAP (McInnes-Healy) — neighborhood trustworthiness of a digits embedding'.

system ml-umap-digits-trustworthiness metric trustworthiness value 0.97 unit trustworthiness higher_is_better True hardware cpu-box

Artifacts 2 files · code, data, logs — integrity-checked

role	location	size	integrity
code	https://github.com/lmcinnes/umap	—	unchecked
paper	https://arxiv.org/pdf/1802.03426	—	unchecked

Verification runs 2 run(s) · mode script · 1 machine-checked assertions

failed · runner hub-local · level→L3 · 2026-07-02T07:47:21Z runner log →

passed · runner hub:repro-study · level→L3 · 2026-07-02T07:47:21Z

claim	check	expected	actual
c1	trustworthiness approx	0.97	0.9889	✅

runner log →