Challenge: Existing methods to summarize text data are limited by the lack of data.
Approach: They propose a method that uses external data to generate synthetic dialogues from short texts containing people and their interpersonal interactions.
Outcome: The proposed method shows robust performance, generalizability, and scalability regardless of complexity of dialogues.

Similar Papers

Simple Conversational Data Augmentation for Semi-supervised Abstractive Dialogue Summarization (2021.emnlp-main)

Copied to clipboard

Challenge: Abstractive conversation summarization models heavily rely on human-annotated summaries.
Approach: They propose a set of Conversational Data Augmentation methods for semi-supervised abstractive conversation summarization that use random swapping/deletion to perturb the discourse relations inside conversations and dialogue-acts-guided insertion to interrupt the development of conversations.
Outcome: The proposed methods over several state-of-the-art datasets show that they are more efficient than previous methods.
Data Augmentation for Low-Resource Dialogue Summarization (2022.findings-naacl)

Copied to clipboard

Challenge: DADS generates synthetic examples by replacing sections of text from input dialogue and summary while preserving the augmented summary to correspond to a viable summary for the simulated dialogue.
Approach: They propose a Data Augmentation technique for low-resource Dialogue Summarization that uses pretrained language models to generate diverse alternatives.
Outcome: The proposed method generates synthetic examples from a low-resource dataset . it produces topically diverse examples without introducing additional hallucinations .
Compositional Data Augmentation for Abstractive Conversation Summarization (2023.acl-long)

Copied to clipboard

Challenge: Abstractive conversation summarization systems rely on large-scale annotated summaries, but collecting and annotating these conversations can be time-consuming and labor-intensive.
Approach: They propose a method for generating diverse and high-quality pairs of conversations and summaries by extracting conversation structures and organizing meaningful conversation snippets.
Outcome: The proposed method outperforms baseline methods on SAMSum and DialogSum datasets and achieves a 10% increase in ROUGE scores with limited data.
Guiding Abstractive Dialogue Summarization with Content Planning (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for abstractive dialogue summarization struggle to maintain factual consistency between dialogue and summary.
Approach: They propose a coarse-to-fine model for generating abstractive dialogue summaries and introduce a fact-aware reinforcement learning objective that improves the fact consistency between the dialogue and the generated summary.
Outcome: The proposed model improves the quality of the generated summary, especially in coherence and consistency.
Align and Augment: Generative Data Augmentation for Compositional Generalization (2024.eacl-long)

Copied to clipboard

Challenge: Recent work on semantic parsing has shown that seq2seq models find compositional generalization challenging.
Approach: They propose a data-augmentation strategy that exploits alignment annotations between sentences and their corresponding meaning representations to improve compositional generalization.
Outcome: The proposed model improves compositional generalization performance by exploiting alignment annotations between sentences and their corresponding meaning representations.
Sequence-to-Sequence Data Augmentation for Dialogue Language Understanding (C18-1)

Copied to clipboard

Challenge: Existing work which augments an utterance without considering its relation with other utterrances, however, has failed to improve the language understanding module.
Approach: They propose a sequence-to-sequence generation based data augmentation framework that leverages one utterance’s same semantic alternatives in the training data.
Outcome: The proposed framework achieves 6.38 and 10.04 F-scores on the Airline Travel Information System dataset and a newly created semantic frame annotation on the Stanford Multi-turn, Multi-domain Dialogue Dataset.
A Finer-grain Universal Dialogue Semantic Structures based Model For Abstractive Dialogue Summarization (2021.findings-emnlp)

Copied to clipboard

Challenge: Abstractive summarization models have achieved impressive results on document summarizing tasks, but their performance on dialogue modeling is poor due to the crude and straight methods for dialogue encoding.
Approach: They propose a model that leverages Finer-grain universal Dialogue semantic Structures to model dialogue and generate better summaries.
Outcome: The proposed model outperforms various dialogue summarization approaches and achieves state-of-the-art (SOTA) ROUGE results on a SAMsum dataset.
Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs (2021.naacl-main)

Copied to clipboard

Challenge: Abstractive conversation summarization has received much attention, but it suffers from insufficient, redundant, or incorrect content due to the unstructured and complex characteristics of human-human interactions.
Approach: They propose to model rich structures in conversations for more precise and accurate conversation summarization by incorporating discourse relations between utterances and action triples in utterrances and designing a multi-granularity decoder to generate summaries by combining all levels of information.
Outcome: The proposed models outperform state-of-the-art methods and generalize well in other domains in terms of automatic evaluations and human judgments.
Mitigating Data Scarceness through Data Synthesis, Augmentation and Curriculum for Abstractive Summarization (2021.findings-emnlp)

Copied to clipboard

Challenge: a new study explores data manipulation techniques for improving abstractive summarization models without the need for any additional data.
Approach: They propose a method of data synthesis with paraphrasing, data augmentation with sample mixing and curriculum learning with new difficulty metrics based on specificity and abstractiveness.
Outcome: The proposed techniques improve abstractive summarization models without additional data . the proposed techniques can be applied in isolation and when combined .
Controllable Meaning Representation to Text Generation: Linearization and Data Augmentation Strategies (2020.emnlp-main)

Copied to clipboard

Challenge: Using task-oriented dialogue generation benchmarks, we compare the effect of four input linearization strategies on controllability and faithfulness.
Approach: They compare the effect of four input linearization strategies on controllability and faithfulness . they also evaluate how a phrase-based data augmentation method can improve performance .
Outcome: The proposed model can generate utterances whose phrases follow the order of the provided plan.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations