QUARTZ: QA-based Unsupervised Abstractive Refinement for Task-oriented Dialogue Summarization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a framework for task-oriented utility-based dialogue summarization is proposed . QUARTZ is a tool for task summarizing dialogues, but its outputs lack task-specific focus. |
| Approach: | They propose a framework for task-oriented utility-based dialogue summarization . QUARTZ generates summaries and question-answer pairs from a dialogue in a zero-shot manner . |
| Outcome: | The proposed framework achieves competitive results in zero-shot settings, rivaling fully-supervised State-of-the-Art methods. |
Similar Papers
Few-shot fine-tuning SOTA summarization models for medical dialogues (2022.naacl-srw)
Copied to clipboard
| Challenge: | Abstractive summarization of medical dialogues is a challenge for standard training approaches due to the paucity of suitable datasets. |
| Approach: | They propose to use medical dialogues to generate abstractive summaries using transformer-based models with zero-shot and few-shot learning strategies. |
| Outcome: | The proposed models were compared with a medical dialogue dataset with 143 snippets and a general domain and dialogue-specific text to assess their performance. |
A Finer-grain Universal Dialogue Semantic Structures based Model For Abstractive Dialogue Summarization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Abstractive summarization models have achieved impressive results on document summarizing tasks, but their performance on dialogue modeling is poor due to the crude and straight methods for dialogue encoding. |
| Approach: | They propose a model that leverages Finer-grain universal Dialogue semantic Structures to model dialogue and generate better summaries. |
| Outcome: | The proposed model outperforms various dialogue summarization approaches and achieves state-of-the-art (SOTA) ROUGE results on a SAMsum dataset. |
SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization (D19-54)
Copied to clipboard
| Challenge: | Existing work on abstractive dialogue summarizations has focused on news summarizing but there is no such comprehensive dataset. |
| Approach: | They propose to use a chat-dialogues corpus with abstractive dialogue summaries to generate a short version of text that covers the main points succinctly. |
| Outcome: | The proposed dataset achieves higher ROUGE scores than the model-generated summaries of news, compared with human evaluators' judgement. |
Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systems (2021.naacl-demos)
Copied to clipboard
Anish Acharya, Suranjit Adhikari, Sanchit Agarwal, Vincent Auvray, Nehal Belgamwar, Arijit Biswas, Shubhra Chandra, Tagyoung Chung, Maryam Fazel-Zarandi, Raefer Gabriel, Shuyang Gao, Rahul Goel, Dilek Hakkani-Tur, Jan Jezabek, Abhay Jha, Jiun-Yu Kao, Prakash Krishnan, Peter Ku, Anuj Goyal, Chien-Wei Lin, Qing Liu, Arindam Mandal, Angeliki Metallinou, Vishal Naik, Yi Pan, Shachi Paul, Vittorio Perera, Abhishek Sethi, Minmin Shen, Nikko Strom, Eddie Wang
| Challenge: | Traditional goal-oriented dialogue systems require annotations which are hard to obtain for every new domain, limiting scalability. |
| Approach: | They propose a data-driven approach to building goal-oriented dialogue systems . they use a seed dialogue simulator to generate annotated conversations instead of collecting annotations . |
| Outcome: | The proposed system improves turn-level action signature prediction accuracy by 50% . the system is scalable, extensible and data efficient . |
Re-FRAME the Meeting Summarization SCOPE: Fact-Based Summarization and Personalization via Questions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | FRAME reframes summarization as a semantic enrichment task . SCOPE is a reason-out-loud protocol that has the model build a reasoning trace . |
| Approach: | They propose a modular pipeline that reframes summarization as a semantic enrichment task. |
| Outcome: | The proposed pipeline reduces hallucinations and omissions by 2 out of 5 points . SCOPE improves knowledge fit and goal alignment over prompt-only baselines . |
AnswerSumm: A Manually-Curated Dataset and Pipeline for Answer Summarization (2022.naacl-main)
Copied to clipboard
| Challenge: | Community Question Answering (CQA) fora lack a dataset to produce answer summarizations . a novel dataset of 4,631 CQA threads is used to generate answer summaries . |
| Approach: | They propose a dataset of 4,631 CQA threads for answer summarization curated by professional linguists. |
| Outcome: | The proposed approach boosts summarization performance according to automatic evaluation. |
Guiding Abstractive Dialogue Summarization with Content Planning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for abstractive dialogue summarization struggle to maintain factual consistency between dialogue and summary. |
| Approach: | They propose a coarse-to-fine model for generating abstractive dialogue summaries and introduce a fact-aware reinforcement learning objective that improves the fact consistency between the dialogue and the generated summary. |
| Outcome: | The proposed model improves the quality of the generated summary, especially in coherence and consistency. |
Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs (2021.naacl-main)
Copied to clipboard
| Challenge: | Abstractive conversation summarization has received much attention, but it suffers from insufficient, redundant, or incorrect content due to the unstructured and complex characteristics of human-human interactions. |
| Approach: | They propose to model rich structures in conversations for more precise and accurate conversation summarization by incorporating discourse relations between utterances and action triples in utterrances and designing a multi-granularity decoder to generate summaries by combining all levels of information. |
| Outcome: | The proposed models outperform state-of-the-art methods and generalize well in other domains in terms of automatic evaluations and human judgments. |
RiSAWOZ: A Large-Scale Multi-Domain Wizard-of-Oz Dataset with Rich Semantic Annotations for Task-Oriented Dialogue Modeling (2020.emnlp-main)
Copied to clipboard
| Challenge: | RiSAWOZ contains 11.2K human-to-human (H2H) multi-turn semantically annotated dialogues spanning over 12 domains . despite of substantial progress made, there are challenges in creating challenging datasets in terms of size, multiple domains, semantic annotations and complexity. |
| Approach: | They propose a large-scale multi-domain Chinese Wizard-of-Oz dataset with rich semantic annotations that captures discourse phenomena for task-oriented dialogue modeling. |
| Outcome: | The proposed dataset contains 11.2K human-to-human (H2H) multi-turn semantically annotated dialogues with more than 150K utterances spanning over 12 domains. |
Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization (2022.coling-1)
Copied to clipboard
| Challenge: | Existing frameworks that use commonsense as supervision only use input knowledge, but it generates more informative and consistent summaries. |
| Approach: | They propose to leverage the unique characteristics of dialogues sharing commonsense knowledge to solve the difficulties in summarizing them. |
| Outcome: | The proposed framework generates more informative and consistent summaries with injected commonsense knowledge than existing methods. |