Papers with Quality
EXPLAIN: Enhancing Retrieval-Augmented Generation with Entity Summary (2025.acl-industry)
Copied to clipboard
Yaozhen Liang, Xiao Liu, Jiajun Yu, Zhouhua Fang, Qunsheng Zou, Linghan Zheng, Yong Li, Zhiwei Liu, Haishuai Wang
| Challenge: | Existing document question answering methods reduce inference costs and input tokens. |
| Approach: | They propose a retrieval-augmented generation method that automatically extracts useful entities and generates summaries from documents. |
| Outcome: | The proposed method surpasses baseline retrieval-augmented generation (RAG) and long-context question answering (LC) methods achieve higher accuracy by processing entire documents, but at the cost of increased computational Corresponding authors. |
From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment (2026.findings-acl)
Copied to clipboard
Ivo Bueno, Babette Bühler, Philipp Stark, Tim Fütterer, Ulrich Trautwein, Dorottya Demszky, Heather Hill, Enkelejda Kasneci
| Challenge: | a framework for sentence-level interpretability of rubric-based scoring is proposed . aaron e. smith: automated scoring models provide little insight into why scores are produced . |
| Approach: | They propose a framework for sentence-level interpretability of rubric-based scoring that combines Shapley-value attributions with rationales generated by large language models. |
| Outcome: | The proposed framework compares fine-tuned pretrained language models with large language models . it shows that fine- tuned models outperform LLMs in prediction accuracy but exhibit label compression toward mid-scale scores . |
The Nautilus Speaker Characterization Corpus: Speech Recordings and Labels of Speaker Characteristics and Voice Descriptions (L18-1)
Copied to clipboard
| Challenge: | The Nautilus Speaker Characterization corpus is a conversational microphone speech recording corpus from 300 speakers. |
| Approach: | They present a speaker characterization corpus from 300 german speakers . they use four scripted and four semi-spontaneous dialogs to simulate telephone calls . |
| Outcome: | The speaker characterization corpus is presented in the acoustically-isolated room Nautilus . it comprises conversational microphone speech recordings from 300 speakers . the data will be made freely available to the scientific community . |
MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation methods focus on fluency and factual reliability, while neglecting figurative quality. |
| Approach: | They propose a set of human evaluation metrics focused on the translation of figurative language and a parallel metaphor corpus generated by post-editing. |
| Outcome: | The proposed evaluation protocol estimates four aspects of MT: Metaphorical Equivalence, Emotion, Authenticity, and Quality. |
DiSCo: Device-Server Collaborative LLM-based Text Streaming Services (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have introduced significant cost and quality of experience (QoE) challenges in serving millions of daily requests. |
| Approach: | They propose a device-server cooperative scheduler that optimizes users’ QoE by adaptively routing requests and migrating response generation between endpoints while maintaining cost constraints. |
| Outcome: | Evaluations on real-world workloads show that the proposed scheduler can reduce tail TTFT (11-52%) and mean TTTT (6-78%) while maintaining comparable QoE levels. |
SubLIME: Subset Selection via Rank Correlation Prediction for Data-Efficient LLM Evaluation (2025.acl-long)
Copied to clipboard
Gayathri Saranathan, Cong Xu, Mahammad Parwez Alam, Tarun Kumar, Martin Foltin, Soon Yee Wong, Suparna Bhattacharya
| Challenge: | Large language models and datasets have made benchmark evaluations computationally prohibitive. |
| Approach: | They propose a framework that reduces evaluation costs by 80% to 99% while preserving ranking fidelity. |
| Outcome: | The proposed evaluation reduces evaluation costs by 80% to 99% while preserving ranking fidelity. |