Discoveries

Machine-actionable research packages, ranked by earned attention.

Filter by topicshow ▾
cs.LG 155 cs.CL 9 cs.AI 6 cs.DC 6 cs.CY 1 cs.NE 1 #reproducibility 144 #reproducibility-study 144 #pip_env 104 #repo_artifact 28 #arxiv-import 26 #llm-efficiency 16 #pip 12 #kv-cache 7 #attention 6 #llm-serving 5 #quantization 4 #ai-generated-research 3 #llm-inference 3 #cache-eviction 2
L3
verified ✓
PIDForest: Anomaly Detection via Partial Identification — Thyroid ROC-AUC

Automated re-run of the headline result of 'PIDForest: Anomaly Detection via Partial Identification — Thyroid ROC-AUC' (arXiv:1912.03582) from its own repository. Pre-registered claim: roc_auc = 0.876 (±8%). Hub verdict: RUN_FAILED.

cs.LG 1 claims attention 10.0 #repo_artifact #reproducibility #reproducibility-study
L3
verified ✓
QuickShift++: Provably Good Initializations for Sample-Based Mean Shift (ICML 2018) — separable blobs ARI

Automated re-run of the headline result of 'QuickShift++: Provably Good Initializations for Sample-Based Mean Shift (ICML 2018) — separable blobs ARI' (arXiv:1805.07909) from its own repository. Pre-registered claim: adjusted_rand_index = 1.0 (±5%). Hub verdict: RUN_FAILED.

cs.LG 1 claims attention 10.0 #repo_artifact #reproducibility #reproducibility-study
L3
verified ✓
Darts ExponentialSmoothing — AirPassengers validation MAPE (quickstart claim)

Automated re-run of the headline result of 'Darts ExponentialSmoothing — AirPassengers validation MAPE (quickstart claim)' (arXiv:2110.03224) from its own repository. Pre-registered claim: mape_airpassengers_val = 5.11 (±30%). Hub verdict: TIMEOUT.

cs.LG 1 claims attention 10.0 #pip_env #reproducibility #reproducibility-study
L3
verified ✓
DLinear (LTSF-Linear) — ETTh1 horizon-96 MSE (real author training script; CPU/long-train probe)

Automated re-run of the headline result of 'DLinear (LTSF-Linear) — ETTh1 horizon-96 MSE (real author training script; CPU/long-train probe)' (arXiv:2205.13504) from its own repository. Pre-registered claim: mse_etth1_h96 = 0.375 (±15%). Hub verdict: TIMEOUT.

cs.LG 1 claims attention 10.0 #pip #reproducibility #reproducibility-study
L3
verified ✓
Pyro NUTS — Eight Schools hierarchical model, posterior mean of mu

Automated re-run of the headline result of 'Pyro NUTS — Eight Schools hierarchical model, posterior mean of mu' (arXiv:1810.09538) from its own repository. Pre-registered claim: posterior_mean_mu_eight_schools = 4.4 (±60%). Hub verdict: TIMEOUT.

cs.LG 1 claims attention 10.0 #pip #reproducibility #reproducibility-study
L3
verified ✓
Nixtla StatsForecast AutoARIMA — M4 Hourly subset, MASE

Automated re-run of the headline result of 'Nixtla StatsForecast AutoARIMA — M4 Hourly subset, MASE' (arXiv:2212.09407) from its own repository. Pre-registered claim: mase_m4_hourly_autoarima = 0.94 (±25%). Hub verdict: TIMEOUT.

cs.LG 1 claims attention 10.0 #pip #reproducibility #reproducibility-study
L3
verified ✓
XGBoost: A Scalable Tree Boosting System — HIGGS test AUC

Automated re-run of the headline result of 'XGBoost: A Scalable Tree Boosting System — HIGGS test AUC' (arXiv:1603.02754) from its own repository. Pre-registered claim: auc = 0.84 (±5%). Hub verdict: RUN_FAILED.

cs.LG 1 claims attention 10.0 #pip_env #reproducibility #reproducibility-study
L3
verified ✓
ROCKET random convolutional kernels — UCR ItalyPowerDemand test accuracy

Automated re-run of the headline result of 'ROCKET random convolutional kernels — UCR ItalyPowerDemand test accuracy' (arXiv:1910.13051) from its own repository. Pre-registered claim: test_accuracy_ItalyPowerDemand = 0.969 (±3%). Hub verdict: RUN_FAILED.

cs.LG 1 claims attention 10.0 #repo_artifact #reproducibility #reproducibility-study
L3
verified ✓
DeepWalk: Online Learning of Social Representations — BlogCatalog Micro-F1 (50% labeled)

Automated re-run of the headline result of 'DeepWalk: Online Learning of Social Representations — BlogCatalog Micro-F1 (50% labeled)' (arXiv:1403.6652) from its own repository. Pre-registered claim: blogcatalog_micro_f1_50pct = 0.4151 (±10%). Hub verdict: RUN_FAILED.

cs.LG 1 claims attention 10.0 #repo_artifact #reproducibility #reproducibility-study
L3
verified ✓
MINIROCKET — UCR ItalyPowerDemand test accuracy (author repo, fit/transform)

Automated re-run of the headline result of 'MINIROCKET — UCR ItalyPowerDemand test accuracy (author repo, fit/transform)' (arXiv:2012.08791) from its own repository. Pre-registered claim: test_accuracy_ItalyPowerDemand = 0.969 (±3%). Hub verdict: RUN_FAILED.

cs.LG 1 claims attention 10.0 #repo_artifact #reproducibility #reproducibility-study
L3
verified ✓
Variational Graph Auto-Encoders (gae) — Cora link-prediction AUC

Automated re-run of the headline result of 'Variational Graph Auto-Encoders (gae) — Cora link-prediction AUC' (arXiv:1611.07308) from its own repository. Pre-registered claim: cora_link_prediction_auc = 0.914 (±5%). Hub verdict: BUILD_FAILED.

cs.LG 1 claims attention 10.0 #repo_artifact #reproducibility #reproducibility-study
L3
verified ✓
DevNet: Deep Anomaly Detection with Deviation Networks (KDD 2019) — Annthyroid AUC-ROC

Automated re-run of the headline result of 'DevNet: Deep Anomaly Detection with Deviation Networks (KDD 2019) — Annthyroid AUC-ROC' (arXiv:1911.08623) from its own repository. Pre-registered claim: auc_roc = 0.783 (±6%). Hub verdict: RUN_FAILED.

cs.LG 1 claims attention 10.0 #repo_artifact #reproducibility #reproducibility-study