Complexity-Weighted Loss and Diverse Reranking for Sentence Simplification (N19-1)
Copied to clipboard
Reno Kriz, João Sedoc, Marianna Apidianaki, Carolina Zheng, Gaurav Kumar, Eleni Miltsakaki, Chris Callison-Burch
| Challenge: | Recent research has applied sequence-to-sequence (Seq2Sequen) models to text simplification . generic models tend to copy directly from the original sentence, resulting in outputs that are long and complex. |
| Approach: | They propose to incorporate word complexities into the loss function during training and generate a large set of diverse candidate simplifications at test time. |
| Outcome: | The proposed model can perform competitively with state-of-the-art systems while generating simpler sentences. |
Similar Papers
Iterative Edit-Based Unsupervised Sentence Simplification (2020.acl-main)
Copied to clipboard
| Challenge: | Sentence simplification is relevant in various real-world and downstream applications. |
| Approach: | They propose an edit-based approach to unsupervised sentence simplification that uses a scoring function to score fluency, simplicity, and meaning preservation to perform edits. |
| Outcome: | The proposed model is more controllable and interpretable than state-of-the-art models on newsela and WikiLarge datasets. |
Dynamic Multi-Level Multi-Task Learning for Sentence Simplification (C18-1)
Copied to clipboard
| Challenge: | Sentence simplification is the task of improving readability and understandability of an input text. |
| Approach: | They propose a strong pointer-copy mechanism based sequence-to-sequence sentence simplification model and a novel ‘multi-level’ soft sharing approach where each auxiliary task shares different (higher versus lower) level layers of the model. |
| Outcome: | The proposed model outperforms competing simplification systems in SARI and FKGL automatic metrics, and human evaluation. |
Controllable Sentence Simplification (2020.lrec-1)
Copied to clipboard
| Challenge: | Text simplification is often considered an all-purpose generic task where the same simplifications are suitable for all but multiple audiences can benefit from simplified text in different ways. |
| Approach: | They propose a controllable simplification model that provides explicit control on simplification systems based on Sequence-to-Sequence models. |
| Outcome: | The proposed model outperforms standard models on simplification benchmarks. |
Split and Rephrase: Better Evaluation and Stronger Baselines (P18-2)
Copied to clipboard
| Challenge: | a dataset mapping a complex sentence to a sequence of sentences conveying the same meaning is challenging in NLP. |
| Approach: | They propose a neural split and a copy-mechanism to break a complex sentence into several shorter sentences that convey the same meaning. |
| Outcome: | The proposed model outperforms the baseline model by 8.68 BLEU and further improves on the task. |
Aligning Sentence Simplification with ESL Learner’s Proficiency for Language Acquisition (2025.naacl-long)
Copied to clipboard
| Challenge: | Text simplification is crucial for improving accessibility and comprehension for English as a Second Language (ESL) learners. |
| Approach: | They propose to simplify complex sentences to appropriate levels while also increasing vocabulary coverage of the target level. |
| Outcome: | The proposed method can increase frequency and diversity of vocabulary of the target level by more than 20% compared to baseline models, while maintaining high simplification quality. |
Sentence Simplification with Memory-Augmented Neural Networks (N18-2)
Copied to clipboard
| Challenge: | Sentence simplification aims to simplify the content and structure of complex sentences . prior work has focused on monolingual machine translation (MT) and tree-based MT (TBMT). |
| Approach: | They adapt an architecture with augmented memory capacities called Neural Semantic Encoders for sentence simplification. |
| Outcome: | The proposed architecture improves on different datasets and improves human judgments. |
Medical Text Simplification: Optimizing for Readability with Unlikelihood Training and Reranked Beam Search Decoding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Text simplification has emerged as an increasingly useful application of AI for bridging the communication gap in specialized fields such as medicine, where the lexicon is often dominated by technical jargon and complex constructs. |
| Approach: | They propose a unlikelihood loss that encourages generation of simpler terms and a reranked beam search decoding method that optimizes for simplicity. |
| Outcome: | The proposed methods achieve better performance on readability metrics on three datasets. |
Adapting Sentence-level Automatic Metrics for Document-level Simplification Evaluation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies on text simplification have focused on sentence simplification, but these metrics often underperform on longer texts. |
| Approach: | They propose to adapt existing sentence-level metrics for paragraph- or document-level simplification by incorporating a new approach to the evaluation of text simplification metrics. |
| Outcome: | The proposed approach outperforms existing sentence-level metrics in terms of correlation with human judgment and the sensitivity and robustness of various metrics to different types of errors produced by existing systems. |
A Non-Autoregressive Edit-Based Approach to Controllable Text Simplification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing models that generate generic simplified outputs for a given source text have been used to specify output properties. |
| Approach: | They propose a non-autoregressive model that iteratively edits an input sequence and incorporates lexical complexity information into the refinement process to generate simplifications that better match the desired output complexity. |
| Outcome: | The proposed model incorporates lexical complexity information into the refinement process to achieve more complex simplification operations such as content deletion and paraphrasing, as well as sentence splitting. |
Controlling Pre-trained Language Models for Grade-Specific Text Simplification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to text simplification control output complexity at corpus level disregarding complexity of individual inputs and considering only one level of output complexity. |
| Approach: | They propose a method that predicts edit operations required for a specific grade level . they say this approach improves the quality of the simplified outputs over corpus-level heuristics . |
| Outcome: | The proposed method improves the readability of simplified outputs over corpus-level search-based heuristics. |