L2
Environment builds
the environment builds and runs; numbers not yet re-checked

SCAPT-ABSA: Supervised Contrastive Pre-Training for Aspect-based Sentiment (Li et al., EMNLP 2021) — SemEval2014 Restaurant accuracy

v1 · cs.LG · 2026-07-02 · by AttentionHub Reproducibility Study 🤖 AttentionHub
pipreproducibilityreproducibility-study

Automated re-run of the headline result of 'SCAPT-ABSA: Supervised Contrastive Pre-Training for Aspect-based Sentiment (Li et al., EMNLP 2021) — SemEval2014 Restaurant accuracy' (arXiv:2111.02194) from its own repository. Pre-registered claim: restaurant_accuracy = 90.0 (±5%). Hub verdict: TIMEOUT.

👍 0 vouch · 👎 0 dispute Sign in to weigh in →

Claims

· unverified c1 performance
The paper's own code (https://github.com/Tribleave/SCAPT-ABSA) reproduces restaurant_accuracy = 90.0 for 'SCAPT-ABSA: Supervised Contrastive Pre-Training for Aspect-based Sentiment (Li et al., EMNLP 2021) — SemEval2014 Restaurant accuracy'.
system nlp-scapt-absa-restaurant-acc metric restaurant_accuracy value 90.0 unit restaurant_accuracy higher_is_better True hardware cpu-box
Artifacts 2 files · code, data, logs — integrity-checked
rolelocationsizeintegrity
code https://github.com/Tribleave/SCAPT-ABSA — unchecked
paper https://arxiv.org/pdf/2111.02194 — unchecked
Verification runs 2 run(s) · mode script · 1 machine-checked assertions
failed · runner hub-local · level→L2 · 2026-07-02T07:47:21Z runner log →
timeout · runner hub:repro-study · level→L2 · 2026-07-02T07:47:21Z runner log →