Compositional Data Augmentation for Abstractive Conversation Summarization (2023.acl-long)
Copied to clipboard
| Challenge: | Abstractive conversation summarization systems rely on large-scale annotated summaries, but collecting and annotating these conversations can be time-consuming and labor-intensive. |
| Approach: | They propose a method for generating diverse and high-quality pairs of conversations and summaries by extracting conversation structures and organizing meaningful conversation snippets. |
| Outcome: | The proposed method outperforms baseline methods on SAMSum and DialogSum datasets and achieves a 10% increase in ROUGE scores with limited data. |
Similar Papers
Simple Conversational Data Augmentation for Semi-supervised Abstractive Dialogue Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive conversation summarization models heavily rely on human-annotated summaries. |
| Approach: | They propose a set of Conversational Data Augmentation methods for semi-supervised abstractive conversation summarization that use random swapping/deletion to perturb the discourse relations inside conversations and dialogue-acts-guided insertion to interrupt the development of conversations. |
| Outcome: | The proposed methods over several state-of-the-art datasets show that they are more efficient than previous methods. |
Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs (2021.naacl-main)
Copied to clipboard
| Challenge: | Abstractive conversation summarization has received much attention, but it suffers from insufficient, redundant, or incorrect content due to the unstructured and complex characteristics of human-human interactions. |
| Approach: | They propose to model rich structures in conversations for more precise and accurate conversation summarization by incorporating discourse relations between utterances and action triples in utterrances and designing a multi-granularity decoder to generate summaries by combining all levels of information. |
| Outcome: | The proposed models outperform state-of-the-art methods and generalize well in other domains in terms of automatic evaluations and human judgments. |
GENDEX: Generative Data Augmentation Strategy Leveraging External Data for Abstractive Dialogue Summarization (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to summarize text data are limited by the lack of data. |
| Approach: | They propose a method that uses external data to generate synthetic dialogues from short texts containing people and their interpersonal interactions. |
| Outcome: | The proposed method shows robust performance, generalizability, and scalability regardless of complexity of dialogues. |
Mitigating Data Scarceness through Data Synthesis, Augmentation and Curriculum for Abstractive Summarization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a new study explores data manipulation techniques for improving abstractive summarization models without the need for any additional data. |
| Approach: | They propose a method of data synthesis with paraphrasing, data augmentation with sample mixing and curriculum learning with new difficulty metrics based on specificity and abstractiveness. |
| Outcome: | The proposed techniques improve abstractive summarization models without additional data . the proposed techniques can be applied in isolation and when combined . |
ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Mining (2021.acl-long)
Copied to clipboard
| Challenge: | Abstractive text summarization has primarily focused on modeling news articles . lack of standardized datasets for summarizing online conversations is a major problem . |
| Approach: | They propose to crowdsource four new datasets for summarizing online conversations . they incorporate argument mining through graph construction to directly model issues, viewpoints, and assertions present in a conversation. |
| Outcome: | The proposed models are compared against widely-used conversation summarization datasets and show comparable or improved results. |
SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization (D19-54)
Copied to clipboard
| Challenge: | Existing work on abstractive dialogue summarizations has focused on news summarizing but there is no such comprehensive dataset. |
| Approach: | They propose to use a chat-dialogues corpus with abstractive dialogue summaries to generate a short version of text that covers the main points succinctly. |
| Outcome: | The proposed dataset achieves higher ROUGE scores than the model-generated summaries of news, compared with human evaluators' judgement. |
Data Augmentation for Multiclass Utterance Classification – A Systematic Study (2020.coling-main)
Copied to clipboard
| Challenge: | a lack of sufficient training data for some categories can cause imbalanced data distributions . a weak classifier may miscategorize a request, resulting in customer dissatisfaction . |
| Approach: | They propose to use random resampling, word-level transformations and neural text generation to augment existing data to cope with imbalanced data. |
| Outcome: | The proposed methods improve utterance classification results by drawing on utterant variation. |
ForumSum: A Multi-Speaker Conversation Summarization Dataset (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Abstractive summarization quality has been improved but there is a lack of data for conversation summarizing applications. |
| Approach: | They propose to build a conversation summarization dataset with human written summaries from internet forums. |
| Outcome: | The proposed dataset can be easily expanded to improve conversation summarization applications. |
A Finer-grain Universal Dialogue Semantic Structures based Model For Abstractive Dialogue Summarization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Abstractive summarization models have achieved impressive results on document summarizing tasks, but their performance on dialogue modeling is poor due to the crude and straight methods for dialogue encoding. |
| Approach: | They propose a model that leverages Finer-grain universal Dialogue semantic Structures to model dialogue and generate better summaries. |
| Outcome: | The proposed model outperforms various dialogue summarization approaches and achieves state-of-the-art (SOTA) ROUGE results on a SAMsum dataset. |
Quantifying Compositionality of Classic and State-of-the-Art Embeddings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Static word embeddings make strong claims about compositionality, but the SOTA generative models go too far in the other direction. |
| Approach: | a new study evaluates the compositionality of word embeddings by canonical correlation analysis . strong compositional signals are observed in later training stages across data modalities . |
| Outcome: | a new evaluation of compositional models shows that they exploit access meanings when justified . strong compositional signals are observed in later training stages and in deeper layers of the transformer-based model before a decline at the top layer. |