Principled Content Selection to Generate Diverse and Personalized Multi-Document Summaries (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models exhibit the _”lost in the middle” phenomenon when they are unevenly attending to different parts of the provided context. |
| Approach: | They propose principled content selection as a way to increase source coverage . they use determinantal point processes to prioritize diverse content . |
| Outcome: | The proposed method improves source coverage on the DiverseSumm benchmark. |
Similar Papers
Tell me what I need to know: Exploring LLM-based (Personalized) Abstractive Multi-Source Meeting Summarization (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods for meeting summarization rely on transcripts and generate generic summaries, failing to contextualize long discussions and to tailor information to individual preferences and productivity requirements. |
| Approach: | They propose a multi-source approach that considers supplementary materials and generates a summary from this enriched transcript. |
| Outcome: | The proposed model increases summary relevance by 9% and produces more content-rich outputs. |
A New Approach to Overgenerating and Scoring Abstractive Summaries (2021.naacl-main)
Copied to clipboard
| Challenge: | Abstractive summarization is a learning objective to produce system outputs that resemble reference summaries on a word-to-word basis. |
| Approach: | They propose a two-staged strategy to generate multiple variants of the target summary and score and select admissible ones according to users’ needs. |
| Outcome: | The proposed approach can achieve state-of-the-art on benchmark summarization datasets. |
Focus Attention: Promoting Faithfulness and Diversity in Summarization (2021.acl-long)
Copied to clipboard
| Challenge: | Currently, document summarization is challenging even for humans. |
| Approach: | They propose a focus attention mechanism which encourages decoders to generate tokens that are topically similar to the input document. |
| Outcome: | The proposed method outperforms top-k and nucleus sampling methods on the BBC extreme summarization task and is more accurate than focus attention-based models. |
Content Selection in Deep Learning Models of Summarization (D18-1)
Copied to clipboard
| Challenge: | Using deep learning models, we find that word embedding does not improve performance over simpler models. |
| Approach: | They propose to use sentence embedding to perform content selection across multiple domains . they propose to propose two alternative models that use auto-regressive sentence extraction . |
| Outcome: | The proposed models improve performance across news, personal stories, meetings, and medical articles. |
What Matters to an LLM? Behavioral and Computational Evidences from Summarization (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly entrusted with the management of information. |
| Approach: | They combine behavioral and computational analyses to find out what LLMs prioritize . they generate length-controlled summaries and derive empirical importance distributions . |
| Outcome: | The proposed model converges on consistent importance patterns and clusters more by family than by size. |
Multi-Document Summarization with Determinantal Point Processes and Contextualized Representations (D19-54)
Copied to clipboard
| Challenge: | Determinantal point processes (DPP) is one of the best performing techniques for extractive summarization. |
| Approach: | They propose to combine determinantal point processes with surface indicators for effective identification of summary-worthy sentences. |
| Outcome: | The determinantal point processes (DPP) framework is one of the best performing in summarization competitions. |
Learning to Control Summaries with Score Ranking (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in summarization focus on improving summary quality across multiple dimensions, but they overlook the challenge of controlling summary generation with respect to individual dimensions. |
| Approach: | They propose a loss function that aligns model outputs with fine-grained, model-based evaluation scores to enable both improvement in summary quality and dimension-specific control. |
| Outcome: | The proposed method improves the overall quality of summaries while maintaining strong control over individual quality dimensions. |
Enhancing LLM Knowledge Learning through Generalization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Continued pre-training on paraphrased data has shown empirical promise for enhancing knowledge acquisition, but this approach is costly and unreliable as it relies on external models or manual effort for rewriting. |
| Approach: | They propose formatting-based data augmentation which diversifies documents conveying the same knowledge by altering document formats rather than their content. |
| Outcome: | The proposed methods improve generalization to diverse paraphrased contexts and enhance pre-training and instruction tuning. |
How Far Can We Extract Diverse Perspectives from Large Language Models? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances of large language models have gained much interest from researchers to exploit their capability of creative generation for data augmentation with less cost and higher diversity. |
| Approach: | They propose a criteria-based prompting technique to extract maximum diversity from LLMs. |
| Outcome: | The proposed method extracts diverse opinions from large language models iteratively. |
A Guide To Effectively Leveraging LLMs for Low-Resource Text Summarization: Data Augmentation and Semi-supervised Approaches (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches for low-resource text summarization use large language models (LLMs) but such models suffer from inconsistent outputs and are difficult to adapt to domain-specific data. |
| Approach: | They propose two methods to effectively utilize large language models for low-resource text summarization. |
| Outcome: | The proposed methods synthesize high-quality documents using LLaMA-3-70b-Instruct model . they achieve competitive ROUGE scores as a fully supervised method with 5% of the labeled data. |