InfoLossQA: Characterizing and Recovering Information Loss in Text Simplification (2024.acl-long)
Copied to clipboard
Jan Trienes, Sebastian Joseph, Jörg Schlötterer, Christin Seifert, Kyle Lo, Wei Xu, Byron Wallace, Junyi Jessy Li
| Challenge: | Text simplification aims to make technical texts more accessible to laypeople but often results in deletion of information and vagueness. |
| Approach: | They propose a framework to characterize and recover simplification-induced information loss in form of question-and-answer (QA) pairs. |
| Outcome: | The proposed framework characterizes and recovers simplification-induced information loss in form of question-and-answer (QA) pairs. |
Similar Papers
Explainable Prediction of Text Complexity: The Missing Preliminaries for Text Simplification (2021.acl-long)
Copied to clipboard
| Challenge: | Text simplification reduces the language complexity of professional content for accessibility purposes. |
| Approach: | They propose that text simplification can be decomposed into a pipeline of tasks . they show that the pipeline can be used to predict whether a text needs to be simplified . |
| Outcome: | The proposed model improves the performance of out-of-sample simplification tests on a blackbox lexical model . the proposed model reduces the complexity of professional text by a large margin . |
Data-Driven Text Simplification (C18-3)
Copied to clipboard
| Challenge: | Automatic text simplification is the process of transforming a complex text into an equivalent version which would be easier to read or understand by automatic natural language processors. |
| Approach: | This tutorial provides an overview of automatic text simplification, which is the process of transforming a complex text into an equivalent version. |
| Outcome: | The aim of this paper is to provide a comprehensive overview of past and current research on automatic text simplification. |
Document-Level Text Simplification: Dataset, Criteria and Baseline (2021.emnlp-main)
Copied to clipboard
| Challenge: | Text simplification is a valuable technique, but research on it is limited. |
| Approach: | They propose a document-level simplification task using Wikipedia dumps as a dataset and propose an automatic evaluation metric called D-SARI. |
| Outcome: | The proposed metric is more suitable for document-level simplification task. |
Evaluating Factuality in Text Simplification (2022.acl-long)
Copied to clipboard
| Challenge: | Automated simplification models aim to make input texts more readable without altering their meaning. |
| Approach: | They propose a taxonomy of errors that are used to analyze simplification models . they propose to use simplification methods to make input texts more readable . |
| Outcome: | The proposed models introduce errors that are not captured by existing evaluation metrics. |
Complexity-Weighted Loss and Diverse Reranking for Sentence Simplification (N19-1)
Copied to clipboard
Reno Kriz, João Sedoc, Marianna Apidianaki, Carolina Zheng, Gaurav Kumar, Eleni Miltsakaki, Chris Callison-Burch
| Challenge: | Recent research has applied sequence-to-sequence (Seq2Sequen) models to text simplification . generic models tend to copy directly from the original sentence, resulting in outputs that are long and complex. |
| Approach: | They propose to incorporate word complexities into the loss function during training and generate a large set of diverse candidate simplifications at test time. |
| Outcome: | The proposed model can perform competitively with state-of-the-art systems while generating simpler sentences. |
Decomposing Textual Information For Style Transfer (D19-56)
Copied to clipboard
| Challenge: | Using a framework of style transfer for texts, we propose several empirical methods to assess information decomposition quality. |
| Approach: | They propose to use latent representations to effectively decompose different aspects of textual information using a framework of style transfer for texts. |
| Outcome: | The proposed methods show that higher quality representations correlate with higher performance in bilingual evaluation understudy (BLEU) between output and human-written reformulations. |
Unsupervised Neural Text Simplification (P19-1)
Copied to clipboard
| Challenge: | Existing unsupervised methods for text simplification are limited to unlabeled text . paper aims to improve the performance of unsupervised systems by incorporating labeled pairs . |
| Approach: | They propose to use unlabeled text to train a neural text simplification framework . they propose to add a pair of attentional-decoders to the framework to improve performance . |
| Outcome: | The proposed model outperforms existing supervised methods on public test data. |
Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA (2023.emnlp-main)
Copied to clipboard
| Challenge: | Traditional human evaluation methods for text simplification often relies on individual, shallow sentence-level ratings, easily affected by the annotator's preference or bias. |
| Approach: | They propose an edit-based human annotation framework that enables holistic and fine-grained text simplification evaluation. |
| Outcome: | The proposed framework is able to predict sentence- and word-level quality simultaneously and report promising results. |
Adapting Sentence-level Automatic Metrics for Document-level Simplification Evaluation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies on text simplification have focused on sentence simplification, but these metrics often underperform on longer texts. |
| Approach: | They propose to adapt existing sentence-level metrics for paragraph- or document-level simplification by incorporating a new approach to the evaluation of text simplification metrics. |
| Outcome: | The proposed approach outperforms existing sentence-level metrics in terms of correlation with human judgment and the sensitivity and robustness of various metrics to different types of errors produced by existing systems. |
Semantic Structural Evaluation for Text Simplification (N18-1)
Copied to clipboard
| Challenge: | Current measures for evaluating text simplification systems focus on lexical aspects, neglecting its structural aspects. |
| Approach: | They propose to use a reference-less automatic evaluation procedure to assess simplification quality by decomposing the input based on its semantic structure and comparing it to the output. |
| Outcome: | The proposed measure has a significant correlation with human judgments and is highly comparable with existing measures. |