Learning to Rank Salient Content for Query-focused Summarization (2024.emnlp-main)
Copied to clipboard
| Challenge: | Query-focused summarization (QFS) is gaining prominence in research community. |
| Approach: | They propose to integrate Learning-to-Rank (LTR) with Query-focused Summarization (QFS) to enhance the summary relevance via content prioritization. |
| Outcome: | The proposed model outperforms the state-of-the-art on QMSum benchmark and SQuALITY benchmark while offering a lower training overhead. |
Similar Papers
Exploring Neural Models for Query-Focused Summarization (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent work in Query-focused summarization lacks a comprehensive study of the broad space of applicable modeling methods. |
| Approach: | They propose to explore two general classes of methods for Query-focused summarization: extractive-abstractive solutions and end-to-end models. |
| Outcome: | The proposed models achieve state-of-the-art on the QMSum dataset, with a margin of 3.38 ROUGE-1, 3.72 ROUGe2 and 3.28 ROUGEL-L. |
Learning to Rank Utterances for Query-Focused Meeting Summarization (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to generate a generic summary for meetings are limited due to the conflict between long meetings and limited input size. |
| Approach: | They propose a Ranker-Generator framework that learns to rank utterances by comparing them in pairs and learning from the global orders, then uses top utterrances as the generator’s input. |
| Outcome: | The proposed model outperforms existing models with fewer parameters due to the conflict between long meetings and limited input size. |
LMGQS: A Large-scale Dataset for Query-focused Summarization (2023.findings-emnlp)
Copied to clipboard
Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Pengcheng He, Chenguang Zhu, Michael Zeng
| Challenge: | Lack of large-scale datasets for query-focused summarization hinders model development . lack of data limits the ability of QFS models to train robust neural models . |
| Approach: | They propose to generate a query for each summary sentence in a generic summarization annotation using a pretrained language model. |
| Outcome: | The proposed model achieves state-of-the-art zero-shot and supervised performance on multiple existing QFS benchmarks. |
Learning to Prioritize: Precision-Driven Sentence Filtering for Long Text Summarization (2022.lrec-1)
Copied to clipboard
| Challenge: | Neural text summarization models are limited by their maximum input length, posing a challenge to summarizing longer texts comprehensively. |
| Approach: | They propose a pre-processing layer that removes low-quality sentences in articles to improve existing summarization models. |
| Outcome: | The proposed approach improves state-of-the-art summarization models on WikiHow and Reddit TIFU datasets by 3.84 and 8.57 points on the full test set and the long article subset. |
Generating Query Focused Summaries from Query-Free Resources (2021.acl-long)
Copied to clipboard
| Challenge: | Existing datasets are small for data-hungry neural architectures and are limited to evaluation purposes. |
| Approach: | They propose to decompose QFS into query modeling and conditional language modeling . they propose a Masked ROUGE Regression framework for evidence estimation and ranking . |
| Outcome: | The proposed model achieves state-of-the-art performance despite weak supervision. |
Document Summarization with Latent Queries (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing benchmarks for query-focused summarization are small for training large neural models. |
| Approach: | They propose a unified modeling framework for query-focused summarization . they model queries as discrete latent variables over document tokens . |
| Outcome: | The proposed framework outperforms strong comparison systems across benchmarks, query types, document settings, and target domains. |
Reinforcement Replaces Supervision: Query focused Summarization using Deep Reinforcement Learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Query-focused Summarization (QfS) is a system that generates summaries from document(s) based on a query. |
| Approach: | They propose a Query-focused Summarization approach that uses a generalization of Reinforcement Learning (RL) for Natural Language Generation and a better semantic similarity reward. |
| Outcome: | The proposed approach improves on the ROUGE-L metric and in a benchmark dataset. |
What Have We Achieved on Text Summarization? (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text summarization have been investigated, but there are still gaps between them and human professionals. |
| Approach: | They analyze 8 major sources of errors on 10 representative summarization models manually. |
| Outcome: | Aiming to gain more understanding of summarization systems with respect to their strengths and limitations on a fine-grained syntactic and semantic level, we use 8 major sources of errors on 10 representative summarizing models. |
SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Sequence-to-sequence neural networks have enabled great progress in abstractive summarization. |
| Approach: | They propose to train a second-stage model performing re-ranking on a set of summary candidates by using a mixture of experts. |
| Outcome: | The proposed model outperforms the base model on CNN- DailyMail, XSum and Reddit TIFU with a base PEGASUS. |
Diffusion Language Model with Query-Document Relevance for Query-Focused Summarization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Query-Focused Summarization (QFS) aims to generate summaries that address specific queries by extracting crucial information from source documents. |
| Approach: | They propose a non-autoregressive diffusion language model that incorporates query-document fragment relevance and query-doctoral global relevance to enhance the adaptability of QFS tasks. |
| Outcome: | The proposed model achieves state-of-the-art performance on Debatepedia and PubMedQA datasets in ROUGE scores, GPT-4, and human evaluations. |