Challenge: a framework to train summarization models with preference feedback is proposed . human-in-the-loop (HITL) allows humans to actively participate in supervising AI systems .
Approach: They propose a framework to train summarization models with preference feedback interactively.
Outcome: The proposed framework improves ROUGE scores and sample-efficiency in active, few-shot and online settings.

Similar Papers

Model-based Preference Optimization in Abstractive Summarization without Human Feedback (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) can generate fluent summaries but often introduce inaccuracies by hallucinating content not found in the source document.
Approach: They propose a method to fine-tune Large Language Models for improved summarization abilities without any human feedback.
Outcome: The proposed method significantly improves the quality of generated summaries without any human feedback.
Interactive Query-Assisted Summarization via Deep Reinforcement Learning (2022.naacl-main)

Copied to clipboard

Challenge: Existing systems that can perform interactive summarization cannot ingest the full document set or operate at sufficient speed for interactivity.
Approach: They propose two deep reinforcement learning models for interactive summarization task . they use interactive session state and history to refrain from redundancy .
Outcome: The proposed model improves informativeness while preserving positive user experience.
PrefScore: Pairwise Preference Learning for Reference-free Summarization Quality Assessment (2022.coling-1)

Copied to clipboard

Challenge: Existing studies on summarization evaluation without a human-written reference summary have shown high correlations with human ratings.
Approach: They propose to judge summary quality by learning preference rank from corrupted summaries . they use Bradley-Terry power ranking model to learn preference rank .
Outcome: Experiments on several datasets show that the proposed model can produce scores highly correlated with human ratings.
Efficient Few-Shot Fine-Tuning for Opinion Summarization (2022.findings-naacl)

Copied to clipboard

Challenge: Abstractive summarization models are typically pre-trained on large amounts of generic texts . large annotated datasets of reviews paired with reference summaries are not available .
Approach: They propose a few-shot method which uses adapters to store in-domain knowledge . they pre-train adapters on unannotated customer reviews and fine-tune them on annotated datasets .
Outcome: The proposed method can store in-domain knowledge and improves on large annotated reviews . it improves coherence and redundancies on the Amazon and Yelp datasets .
Can Language Models Capture Human Writing Preferences for Domain-Specific Text Summarization? (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies employ large language models as auxiliary tools for humancentered NLP.
Approach: They construct a model to capture human writing preferences by fine-tuning pre-trained models with data and designing prompts to optimize the output of large language models.
Outcome: The proposed model captures human writing preferences through the dimensions of length, content depth, tone & style, and summary format.
GSum: A General Framework for Guided Neural Abstractive Summarization (2021.naacl-main)

Copied to clipboard

Challenge: Abstractive summarization models are flexible, but they can be difficult to control.
Approach: They propose a general and extensible guided summarization framework that takes different kinds of guidance as input and perform experiments across different varieties.
Outcome: The proposed framework can generate more faithful summaries and different types of guidance generate qualitatively different summary.
A Closer Look at Data Bias in Neural Extractive Summarization Models (D19-54)

Copied to clipboard

Challenge: In this paper, we examine the generalization behaviour of summarization models . we propose several properties of datasets that matter for generalization .
Approach: They propose several properties of datasets which matter for generalization of summarization models.
Outcome: The proposed approach improves the state-of-the-art model by rethinking the model design process on a typical dataset.
Learning to Prioritize: Precision-Driven Sentence Filtering for Long Text Summarization (2022.lrec-1)

Copied to clipboard

Challenge: Neural text summarization models are limited by their maximum input length, posing a challenge to summarizing longer texts comprehensively.
Approach: They propose a pre-processing layer that removes low-quality sentences in articles to improve existing summarization models.
Outcome: The proposed approach improves state-of-the-art summarization models on WikiHow and Reddit TIFU datasets by 3.84 and 8.57 points on the full test set and the long article subset.
The State and Fate of Summarization Datasets: A Survey (2025.naacl-long)

Copied to clipboard

Challenge: Summarization is the task of shortening a text while preserving the most important information it contains.
Approach: They propose a novel ontology covering sample properties, collection methods and distribution covering sample characteristics, collection method and distribution.
Outcome: The proposed ontology covers sample properties, collection methods and distribution, and can be used to streamline future research into a more coherent body of work.
Inverse Reinforcement Learning for Text Summarization (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies show that inverse reinforcement learning (RL) training has certain disadvantages such as object mismatch and exposure bias.
Approach: They propose inverse reinforcement learning (IRL) as an effective paradigm for training abstractive summarization models.
Outcome: The proposed model outperforms MLE and RL baselines on ROUGE, coverage, novelty, compression ratio, factuality, and human evaluations.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations