Papers by Gondy Leroy
APPLS: Evaluating Evaluation Metrics for Plain Language Summarization (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation metrics for plain language summarization (PLS) lack a dedicated assessment metric and the suitability of text generation evaluation metrics is unclear due to unique transformations. |
| Approach: | They propose a granular meta-evaluation testbed to evaluate PLS metrics . they identify four PLS criteria and define perturbations that sensitive metrics should be able to detect . |
| Outcome: | The proposed testbed assesses performance of 14 existing metrics including scores, features, and prompt-based evaluations. |
AutoMeTS: The Autocomplete for Medical Text Simplification (2020.coling-main)
Copied to clipboard
| Challenge: | Semi-automated text simplification approaches can be used to simplify text faster and at a higher quality. |
| Approach: | They propose to use autocomplete to simplify medical texts using aligned English Wikipedia sentences and pretrained neural language models to analyze the additional context. |
| Outcome: | The proposed model outperforms the best individual model by 2.1% and achieves a word prediction accuracy of 64.52%. |