Papers by Linlin Song
CLEME2.0: Towards Interpretable Evaluation by Disentangling Edits for Grammatical Error Correction (2025.acl-long)
Copied to clipboard
Jingheng Ye, Zishan Xu, Yinghui Li, Linlin Song, Qingyu Zhou, Hai-Tao Zheng, Ying Shen, Wenhao Jiang, Hong-Gee Kim, Ruitong Liu, Xin Su, Zifei Shan
| Challenge: | Existing studies have focused on the interpretability of Grammatical Error Correction (GEC) evaluation metrics, but the interpretabilty of these metrics has been neglected. |
| Approach: | They propose a reference-based metric that describes four aspects of GEC systems: hit-correction, wrong-corrections, under-correcties, and over-corrects. |
| Outcome: | The proposed metric reveals critical qualities and locates drawbacks of GEC systems. |
Diagnosing Failures in Large Language Models’ Answers: Integrating Error Attribution into Evaluation Framework (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation models lack error attribution capability due to their proprietary nature. |
| Approach: | They propose a misattribution framework with 6 primary and 15 secondary categories to facilitate in-depth analysis. |
| Outcome: | The proposed framework is based on a dataset specifically designed for error attribution, along with the corresponding scores and feedback. |