Revisiting Sentence Union Generation as a Testbed for Text Consolidation (2023.findings-acl)
Copied to clipboard
| Challenge: | In order to acquire knowledge on a new subject, it is often necessary to consult multiple sources of written information. |
| Approach: | They propose to revisit the sentence union generation task as an effective well-defined testbed for assessing text consolidation capabilities. |
| Outcome: | The proposed evaluation protocol includes human and automatic evaluations. |
Similar Papers
Extending Multi-Text Sentence Fusion Resources via Pyramid Annotations (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing datasets for sentence fusion tasks are limited in size and scope . despite recent advances, cross-document tasks such as multi-document summarization have not progressed with the same pace. |
| Approach: | They propose to extend a sentence fusion dataset by almost four times its original size . they relabel the dataset and employ more data sources to improve model performance . |
| Outcome: | The proposed dataset triples the size of an earlier dataset and improves performance . it also includes more complex training instances better reflecting those found in "the wild" |
Answer Consolidation: Formulation and Benchmarking (2022.naacl-main)
Copied to clipboard
| Challenge: | Current question answering systems assume each question to have one correct answer. |
| Approach: | They propose a problem where answers are partitioned into multiple groups . they construct a comprehensive and non-redundant set of answers by picking one answer from each group . |
| Outcome: | The proposed model performs better than previous models, but it needs further improvements. |
I already said that! Degenerating redundant questions in open-domain dialogue systems. (2023.acl-srw)
Copied to clipboard
| Challenge: | Neural text generation models have been successful in short open-domain conversations, but their performance degrades significantly in the long term. |
| Approach: | They propose a method to generate training data without crowdsourcing . they adapt negative training, decoding, and classification methods to mitigate redundancy problem . |
| Outcome: | The proposed method reduces the rate of redundant questions from 27.2% to 8.7% while improving the quality of the original model. |
DiscoFuse: A Large-Scale Dataset for Discourse-Based Sentence Fusion (N19-1)
Copied to clipboard
| Challenge: | Existing datasets for sentence fusion are small and insufficient for training modern neural models. |
| Approach: | They propose a method for automatically-generating fusion examples from raw text . they apply their method to Wikipedia and Sports articles to generate fusion models . |
| Outcome: | The proposed method improves performance on WebSplit when viewed as a sentence fusion task. |
Semantically Driven Sentence Fusion: Modeling and Evaluation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Sentence fusion is the task of joining related sentences into coherent text. |
| Approach: | They propose a method where ground-truth solutions are automatically expanded into multiple references via curated equivalence classes of connective phrases. |
| Outcome: | The proposed approach improves on state-of-the-art models by expanding ground-truth solutions into multiple references. |
BLEU is Not Suitable for the Evaluation of Text Simplification (D18-1)
Copied to clipboard
| Challenge: | BLEU is widely considered to be an informative metric for text-to-text generation . Xu et al. (2016) found that BLUE is not suitable for evaluation of sentence splitting . |
| Approach: | They propose to use BLEU to evaluate sentence splitting as a metric for machine translation . they propose to compare BLUE with a corpus containing multiple structural paraphrases . |
| Outcome: | The proposed BLEU is not suitable for evaluation of sentence splitting . a correlation analysis with human judgments shows low correlation with BLUE . |
A Sentiment Consolidation Framework for Meta-Review Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Recent advances in abstractive text summarization have created plausible summaries, but it is unclear if they truly possess the capability of information consolidation to generate summary. |
| Approach: | They propose to prompt large language models to generate meta-reviews and use evaluation metrics to assess the quality of generated meta- reviews. |
| Outcome: | The proposed framework proves that human meta-reviewers follow a framework of sentiment consolidation to write meta- reviews compared with prompting them with simple instructions. |
Crowd-sourcing annotation of complex NLU tasks: A case study of argumentative content annotation (D19-59)
Copied to clipboard
| Challenge: | Recent advances in machine reading and listening comprehension involve the annotation of long texts. |
| Approach: | They propose a way to perform a sentence-by-sentence annotation task with crowd annotators. |
| Outcome: | The proposed approach can be used to identify claims in a debate speech. |
Automatic and Human-AI Interactive Text Generation (with a focus on Text Simplification and Revision) (2024.acl-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we focus on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and then generates a revision that is improved according to some specific criteria. |
| Approach: | This tutorial focuses on text-to-text generation, a class of natural language generation tasks that takes a piece of text as input and generates a revision that is improved according to some specific criteria. |
| Outcome: | This tutorial focuses on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and generates a revision that is improved according to some specificcriteria. |
AREDSUM: Adaptive Redundancy-Aware Iterative Sentence Ranking for Extractive Document Summarization (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing studies on redundancy are focused on salience alone. |
| Approach: | They propose to combine salience and novelty to score redundancy in extractive summarization systems . they also propose to balance saliance and redundancies by scoring redundants first . |
| Outcome: | Empirical results show that AREDSUM-CTX scores salience first, then learns to balance saliency and redundancy. |