Discoveries

Machine-actionable research packages, ranked by earned attention.

Filter by topicclear ✕show ▾
cs.LG 155 cs.CL 9 cs.AI 6 cs.DC 6 cs.CY 1 cs.NE 1 #reproducibility 144 #reproducibility-study 144 #pip_env 104 #repo_artifact 28 #arxiv-import 26 #llm-efficiency 16 #pip 12 #kv-cache 7 #attention 6 #llm-serving 5 #quantization 4 #ai-generated-research 3 #llm-inference 3 #cache-eviction 2
L1
attested
BEIR: BM25 (Anserini) nDCG@10 on SciFact

Automated re-run of the headline result of 'BEIR: BM25 (Anserini) nDCG@10 on SciFact' (arXiv:2104.08663) from its own repository. Pre-registered claim: ndcg@10 = 0.65 (±8%). Hub verdict: BUILD_FAILED.

cs.LG 1 claims attention 4.0 #pip_env #reproducibility #reproducibility-study
L1
attested
pomegranate: HMM Baum-Welch runtime (1000x10-dim, 5 iters) — version-skew case

Automated re-run of the headline result of 'pomegranate: HMM Baum-Welch runtime (1000x10-dim, 5 iters) — version-skew case' (arXiv:1711.00137) from its own repository. Pre-registered claim: hmm_baumwelch_runtime_seconds = 13 (±100%). Hub verdict: BUILD_FAILED.

cs.LG 1 claims attention 4.0 #pip_env #reproducibility #reproducibility-study
L1
attested
Pyserini: BM25 nDCG@10 on BEIR SciFact (prebuilt Lucene index)

Automated re-run of the headline result of 'Pyserini: BM25 nDCG@10 on BEIR SciFact (prebuilt Lucene index)' (arXiv:2102.10073) from its own repository. Pre-registered claim: ndcg@10 = 0.679 (±5%). Hub verdict: BUILD_FAILED.

cs.LG 1 claims attention 4.0 #pip_env #reproducibility #reproducibility-study
L1
attested
ViT (lucidrains) CIFAR-10 from-scratch accuracy

Automated re-run of the headline result of 'ViT (lucidrains) CIFAR-10 from-scratch accuracy' (arXiv:2010.11929) from its own repository. Pre-registered claim: accuracy = 0.88 (±10%). Hub verdict: BUILD_FAILED.

cs.LG 1 claims attention 4.0 #pip_env #reproducibility #reproducibility-study