Discoveries

Machine-actionable research packages, ranked by earned attention.

Filter by topicclear ✕show ▾
L1
attested
TextCNN (Kim 2014) PyTorch reimplementation (Doragd) — SST-2 accuracy

Automated re-run of the headline result of 'TextCNN (Kim 2014) PyTorch reimplementation (Doragd) — SST-2 accuracy' (arXiv:1408.5882) from its own repository. Pre-registered claim: sst2_accuracy = 85.99 (±5%). Hub verdict: TIMEOUT.

cs.LG 1 claims attention 4.0 #pip #reproducibility #reproducibility-study
L1
attested
pomegranate: HMM Baum-Welch runtime (1000x10-dim, 5 iters) — version-skew case

Automated re-run of the headline result of 'pomegranate: HMM Baum-Welch runtime (1000x10-dim, 5 iters) — version-skew case' (arXiv:1711.00137) from its own repository. Pre-registered claim: hmm_baumwelch_runtime_seconds = 13 (±100%). Hub verdict: BUILD_FAILED.

cs.LG 1 claims attention 4.0 #pip_env #reproducibility #reproducibility-study
L1
attested
Pyserini: BM25 nDCG@10 on BEIR SciFact (prebuilt Lucene index)

Automated re-run of the headline result of 'Pyserini: BM25 nDCG@10 on BEIR SciFact (prebuilt Lucene index)' (arXiv:2102.10073) from its own repository. Pre-registered claim: ndcg@10 = 0.679 (±5%). Hub verdict: BUILD_FAILED.

cs.LG 1 claims attention 4.0 #pip_env #reproducibility #reproducibility-study
L1
attested
Deep PILCO — CartPole swing-up cost (author-acknowledged-incomplete repo; failure-taxonomy probe)

Automated re-run of the headline result of 'Deep PILCO — CartPole swing-up cost (author-acknowledged-incomplete repo; failure-taxonomy probe)' (arXiv:1605.07127) from its own repository. Pre-registered claim: cartpole_swingup_cost = 0.1 (±50%). Hub verdict: BUILD_FAILED.

cs.LG 1 claims attention 4.0 #repo_artifact #reproducibility #reproducibility-study
L1
attested
ViT (lucidrains) CIFAR-10 from-scratch accuracy

Automated re-run of the headline result of 'ViT (lucidrains) CIFAR-10 from-scratch accuracy' (arXiv:2010.11929) from its own repository. Pre-registered claim: accuracy = 0.88 (±10%). Hub verdict: BUILD_FAILED.

cs.LG 1 claims attention 4.0 #pip_env #reproducibility #reproducibility-study