L2
Environment builds
the environment builds and runs; numbers not yet re-checked
word2vec via gensim: Google analogy accuracy (skip-gram, text8 corpus)
Automated re-run of the headline result of 'word2vec via gensim: Google analogy accuracy (skip-gram, text8 corpus)' (arXiv:1301.3781) from its own repository. Pre-registered claim: analogy_accuracy = 0.6 (±40%). Hub verdict: DIVERGED.
Claims
· unverified
c1
performance
The paper's own code (https://github.com/piskvorky/gensim) reproduces analogy_accuracy = 0.6 for 'word2vec via gensim: Google analogy accuracy (skip-gram, text8 corpus)'.
system gensim-word2vec-analogy
metric analogy_accuracy
value 0.6
unit analogy_accuracy
higher_is_better True
hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
| role | location | size | integrity |
|---|---|---|---|
| code | https://github.com/piskvorky/gensim | — | unchecked |
| paper | https://arxiv.org/pdf/1301.3781 | — | unchecked |
Verification runs 2 run(s) · mode script · 1 machine-checked assertions
failed · runner hub-local · level→L2 · 2026-07-02T07:47:20Z
runner log →
failed · runner hub:repro-study · level→L2 · 2026-07-02T07:47:20Z
runner log →
| claim | check | expected | actual | |
|---|---|---|---|---|
| c1 | analogy_accuracy approx | 0.6 | 0.2883 | ❌ |