ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models for sentence simplification are focused on a single transformation, such as lexical paraphrasing or splitting. |
| Approach: | They propose a dataset for assessing sentence simplification in English using a crowdsourced multi-reference corpus. |
| Outcome: | The proposed dataset shows that it captures characteristics of simplicity better than other datasets. |
Similar Papers
Document-Level Text Simplification: Dataset, Criteria and Baseline (2021.emnlp-main)
Copied to clipboard
| Challenge: | Text simplification is a valuable technique, but research on it is limited. |
| Approach: | They propose a document-level simplification task using Wikipedia dumps as a dataset and propose an automatic evaluation metric called D-SARI. |
| Outcome: | The proposed metric is more suitable for document-level simplification task. |
Revisiting non-English Text Simplification: A Unified Multilingual Benchmark (2023.acl-long)
Copied to clipboard
| Challenge: | Recent advances in English automatic text simplification have pushed the frontier of multilingual text simulating. |
| Approach: | They propose to use multilingual evaluation benchmarks to evaluate multilingual text simplification models in English and other languages. |
| Outcome: | The proposed benchmark outperforms pre-trained models in Russian in zero-shot cross-lingual transfer to low-resource languages. |
Linguistic Corpus Annotation for Automatic Text Simplification Evaluation (2022.emnlp-main)
Copied to clipboard
Rémi Cardon, Adrien Bibal, Rodrigo Wilkens, David Alfter, Magali Norré, Adeline Müller, Watrin Patrick, Thomas François
| Challenge: | Evaluating automatic text simplification systems is a difficult task that is performed either by automatic metrics or user-based evaluations. |
| Approach: | They propose to use annotations of the ASSET corpus to analyze SARI’s behavior and to re-evaluate existing ATS systems. |
| Outcome: | The proposed methods can be used to analyze SARI’s behavior and to re-evaluate existing ATS systems. |
Adapting Sentence-level Automatic Metrics for Document-level Simplification Evaluation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies on text simplification have focused on sentence simplification, but these metrics often underperform on longer texts. |
| Approach: | They propose to adapt existing sentence-level metrics for paragraph- or document-level simplification by incorporating a new approach to the evaluation of text simplification metrics. |
| Outcome: | The proposed approach outperforms existing sentence-level metrics in terms of correlation with human judgment and the sensitivity and robustness of various metrics to different types of errors produced by existing systems. |
Dynamic Multi-Level Multi-Task Learning for Sentence Simplification (C18-1)
Copied to clipboard
| Challenge: | Sentence simplification is the task of improving readability and understandability of an input text. |
| Approach: | They propose a strong pointer-copy mechanism based sequence-to-sequence sentence simplification model and a novel ‘multi-level’ soft sharing approach where each auxiliary task shares different (higher versus lower) level layers of the model. |
| Outcome: | The proposed model outperforms competing simplification systems in SARI and FKGL automatic metrics, and human evaluation. |
MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases (2022.lrec-1)
Copied to clipboard
| Challenge: | MUSS trains strong models using sentence-level paraphrase data instead of labeled simplification data. |
| Approach: | They propose a multilingual unsupervised sentence simplification system that does not require labeled simplification data. |
| Outcome: | The proposed model outperforms the previous best supervised models on English, French, and Spanish benchmarks despite not using labeled simplification data. |
Multi-Word Lexical Simplification (2020.coling-main)
Copied to clipboard
| Challenge: | In text simplification, individual words are replaced with their simpler equivalents, but single word substitutions do not cover the full complexity of techniques humans use to approach text simulating. |
| Approach: | They propose a task of multi-word lexical simplification in which a sentence is made easier to understand by replacing its fragment with a simpler alternative. |
| Outcome: | The proposed method is based on a purpose-trained neural language model and evaluates against human and resource-based baselines. |
Learning to Paraphrase Sentences to Different Complexity Levels (2023.tacl-1)
Copied to clipboard
| Challenge: | Using unsupervised datasets, we train models on sentence complexification and same-level paraphrasing tasks. |
| Approach: | They compare two unsupervised datasets with a single supervised dataset to train models on sentence complexification and same-level paraphrasing tasks. |
| Outcome: | The proposed models outperform previous work on sentence-level targeting and improve on the ASSET simplification benchmark. |
Enhancing Sentence Simplification in Portuguese: Leveraging Paraphrases, Context, and Linguistic Features (2024.findings-acl)
Copied to clipboard
| Challenge: | Automated text simplification requires (paired) datasets that are scarce in languages other than English. |
| Approach: | They propose a method that leverages paraphrases, context, and linguistic attributes to overcome the absence of paired texts in Portuguese. |
| Outcome: | The proposed model surpasses the current state-of-the-art while competing with a Large Language Model. |
EASSE: Easier Automatic Sentence Simplification Evaluation (D19-3)
Copied to clipboard
| Challenge: | EASSE provides access to a broad range of evaluation resources including standard automatic metrics, word-level accuracy scores and reference-independent quality estimation features. |
| Approach: | They propose to provide a Python package that provides access to automatic evaluation and comparison of Sentence Simplification (SS) systems. |
| Outcome: | The proposed tool allows comparison and understanding of the performance of Sentence Simplification (SS) systems. |