MoDS: Moderating a Mixture of Document Speakers to Summarize Debatable Queries in Document Collections (2025.naacl-long)
Copied to clipboard
Nishant Balepur, Alexa Siu, Nedim Lipka, Franck Dernoncourt, Tong Sun, Jordan Lee Boyd-Graber, Puneet Mathur
| Challenge: | Query-focused summarization (QFS) gives an overview of documents to answer a query, ignoring debatable ones. |
| Approach: | They propose a multi-LLM framework that uses a Query-focused summarization approach to create balanced summaries that answer debatable queries. |
| Outcome: | The proposed framework beats SOTA by 38-59% in topic paragraph coverage and balance, based on new citation metrics. |
Similar Papers
LMGQS: A Large-scale Dataset for Query-focused Summarization (2023.findings-emnlp)
Copied to clipboard
Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Pengcheng He, Chenguang Zhu, Michael Zeng
| Challenge: | Lack of large-scale datasets for query-focused summarization hinders model development . lack of data limits the ability of QFS models to train robust neural models . |
| Approach: | They propose to generate a query for each summary sentence in a generic summarization annotation using a pretrained language model. |
| Outcome: | The proposed model achieves state-of-the-art zero-shot and supervised performance on multiple existing QFS benchmarks. |
Diffusion Language Model with Query-Document Relevance for Query-Focused Summarization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Query-Focused Summarization (QFS) aims to generate summaries that address specific queries by extracting crucial information from source documents. |
| Approach: | They propose a non-autoregressive diffusion language model that incorporates query-document fragment relevance and query-doctoral global relevance to enhance the adaptability of QFS tasks. |
| Outcome: | The proposed model achieves state-of-the-art performance on Debatepedia and PubMedQA datasets in ROUGE scores, GPT-4, and human evaluations. |
Generating Query Focused Summaries from Query-Free Resources (2021.acl-long)
Copied to clipboard
| Challenge: | Existing datasets are small for data-hungry neural architectures and are limited to evaluation purposes. |
| Approach: | They propose to decompose QFS into query modeling and conditional language modeling . they propose a Masked ROUGE Regression framework for evidence estimation and ranking . |
| Outcome: | The proposed model achieves state-of-the-art performance despite weak supervision. |
Q-STRUM Debate: Query-Driven Contrastive Summarization for Recommendation Comparison (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing contrastive summarization methods such as STRUM-LLM fail to clarify differences between items . emergence of large language models (LLMs) has revolutionized QCS capabilities . |
| Approach: | They propose a new method that generates focused and contrastive summaries by using debate-style prompting. |
| Outcome: | Experiments show that Q-STRUM Debate performs better than existing methods on key contrastive summarization criteria. |
DebateQA: Evaluating Question Answering on Debatable Knowledge (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing QA benchmarks that provide fixed answers to debatable questions are inadequate for evaluating their performance. |
| Approach: | They propose to use a dataset of 2,941 debatable questions to assess their ability to provide comprehensive answers to inherently debatably asked questions. |
| Outcome: | The proposed model performs well on 2,941 debatable questions accompanied by human-annotated partial answers that capture a variety of perspectives. |
Document Summarization with Latent Queries (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing benchmarks for query-focused summarization are small for training large neural models. |
| Approach: | They propose a unified modeling framework for query-focused summarization . they model queries as discrete latent variables over document tokens . |
| Outcome: | The proposed framework outperforms strong comparison systems across benchmarks, query types, document settings, and target domains. |
Reinforcement Replaces Supervision: Query focused Summarization using Deep Reinforcement Learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Query-focused Summarization (QfS) is a system that generates summaries from document(s) based on a query. |
| Approach: | They propose a Query-focused Summarization approach that uses a generalization of Reinforcement Learning (RL) for Natural Language Generation and a better semantic similarity reward. |
| Outcome: | The proposed approach improves on the ROUGE-L metric and in a benchmark dataset. |
Exploring Neural Models for Query-Focused Summarization (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent work in Query-focused summarization lacks a comprehensive study of the broad space of applicable modeling methods. |
| Approach: | They propose to explore two general classes of methods for Query-focused summarization: extractive-abstractive solutions and end-to-end models. |
| Outcome: | The proposed models achieve state-of-the-art on the QMSum dataset, with a margin of 3.38 ROUGE-1, 3.72 ROUGe2 and 3.28 ROUGEL-L. |
MDS: A Fine-Grained Dataset for Multi-Modal Dialogue Summarization (2024.lrec-main)
Copied to clipboard
| Challenge: | Summarizing the dialogue into a short message has drawn much attention due to the explosion of various dialogue scenes. |
| Approach: | They develop a multi-modal dialogue summarization dataset to enhance the variety of data available for this research area. |
| Outcome: | The proposed dataset provides a demanding testbed for multi-modal dialogue summarization. |
Improve Query Focused Abstractive Summarization by Incorporating Answer Relevance (2021.findings-acl)
Copied to clipboard
| Challenge: | Query focused summarization models aim to generate summaries from source documents that can answer the given query. |
| Approach: | They propose a QFS-BART model that incorporates the explicit answer relevance of the source documents given the query via a question answering model. |
| Outcome: | Empirical results show that the proposed model achieves the new state-of-the-art performance. |