L1
Integrity-checked
claims carry evidence but haven't been re-run (attested)
Distributed Representations of Sentences and Documents (Doc2Vec/Paragraph Vector, Le & Mikolov 2014) — IMDB sentiment accuracy, gensim reproduction
Automated re-run of the headline result of 'Distributed Representations of Sentences and Documents (Doc2Vec/Paragraph Vector, Le & Mikolov 2014) — IMDB sentiment accuracy, gensim reproduction' (arXiv:1405.4053) from its own repository. Pre-registered claim: imdb_accuracy = 0.87 (±8%). Hub verdict: RUN_FAILED.
Claims
· unverified
c1
performance
The paper's own code (https://github.com/linanqiu/word2vec-sentiments) reproduces imdb_accuracy = 0.87 for 'Distributed Representations of Sentences and Documents (Doc2Vec/Paragraph Vector, Le & Mikolov 2014) — IMDB sentiment accuracy, gensim reproduction'.
system nlp-doc2vec-imdb-acc
metric imdb_accuracy
value 0.87
unit imdb_accuracy
higher_is_better True
hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
| role | location | size | integrity |
|---|---|---|---|
| code | https://github.com/linanqiu/word2vec-sentiments | — | unchecked |
| paper | https://arxiv.org/pdf/1405.4053 | — | unchecked |
Verification runs 3 run(s) · mode script · 1 machine-checked assertions
failed · runner hub:repro-study · level→L1 · 2026-07-02T11:39:48Z
runner log →
failed · runner hub-local · level→L2 · 2026-07-02T07:47:21Z
runner log →
failed · runner hub:repro-study · level→L1 · 2026-07-02T07:47:21Z
runner log →