Challenge: Scientific Query-Focused Summarization (Sci-QFS) has lagged in development due to the lack of data.
Approach: They propose a method to take advantage of existing academic papers to obtain large-scale datasets for this task automatically.
Outcome: The proposed method outperforms existing models on the datasets and shows that it is relatively straightforward for humans.

Similar Papers

Generating Query Focused Summaries from Query-Free Resources (2021.acl-long)

Copied to clipboard

Challenge: Existing datasets are small for data-hungry neural architectures and are limited to evaluation purposes.
Approach: They propose to decompose QFS into query modeling and conditional language modeling . they propose a Masked ROUGE Regression framework for evidence estimation and ranking .
Outcome: The proposed model achieves state-of-the-art performance despite weak supervision.
LMGQS: A Large-scale Dataset for Query-focused Summarization (2023.findings-emnlp)

Copied to clipboard

Challenge: Lack of large-scale datasets for query-focused summarization hinders model development . lack of data limits the ability of QFS models to train robust neural models .
Approach: They propose to generate a query for each summary sentence in a generic summarization annotation using a pretrained language model.
Outcome: The proposed model achieves state-of-the-art zero-shot and supervised performance on multiple existing QFS benchmarks.
A Summarization System for Scientific Documents (D19-3)

Copied to clipboard

Challenge: a qualitative user study identified the most valuable scenarios for scientific content consumption.
Approach: They propose a system that retrieves and summarizes scientific documents for a given information need.
Outcome: The proposed system ingested 270,000 scientific papers and validated with human experts.
How well do you know your summarization datasets? (2021.findings-acl)

Copied to clipboard

Challenge: State-of-the-art summarization systems are trained on massive datasets scraped from the web.
Approach: They manually analyse 600 samples from three popular summarization datasets . they use a six-class typology which captures different noise types and degrees of summarizing difficulty.
Outcome: The proposed model performs better on large datasets than on the current models.
Exploring Neural Models for Query-Focused Summarization (2022.findings-naacl)

Copied to clipboard

Challenge: Recent work in Query-focused summarization lacks a comprehensive study of the broad space of applicable modeling methods.
Approach: They propose to explore two general classes of methods for Query-focused summarization: extractive-abstractive solutions and end-to-end models.
Outcome: The proposed models achieve state-of-the-art on the QMSum dataset, with a margin of 3.38 ROUGE-1, 3.72 ROUGe2 and 3.28 ROUGEL-L.
Document Summarization with Latent Queries (2022.tacl-1)

Copied to clipboard

Challenge: Existing benchmarks for query-focused summarization are small for training large neural models.
Approach: They propose a unified modeling framework for query-focused summarization . they model queries as discrete latent variables over document tokens .
Outcome: The proposed framework outperforms strong comparison systems across benchmarks, query types, document settings, and target domains.
The State and Fate of Summarization Datasets: A Survey (2025.naacl-long)

Copied to clipboard

Challenge: Summarization is the task of shortening a text while preserving the most important information it contains.
Approach: They propose a novel ontology covering sample properties, collection methods and distribution covering sample characteristics, collection method and distribution.
Outcome: The proposed ontology covers sample properties, collection methods and distribution, and can be used to streamline future research into a more coherent body of work.
Reinforcement Replaces Supervision: Query focused Summarization using Deep Reinforcement Learning (2023.emnlp-main)

Copied to clipboard

Challenge: Query-focused Summarization (QfS) is a system that generates summaries from document(s) based on a query.
Approach: They propose a Query-focused Summarization approach that uses a generalization of Reinforcement Learning (RL) for Natural Language Generation and a better semantic similarity reward.
Outcome: The proposed approach improves on the ROUGE-L metric and in a benchmark dataset.
What Have We Achieved on Text Summarization? (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for text summarization have been investigated, but there are still gaps between them and human professionals.
Approach: They analyze 8 major sources of errors on 10 representative summarization models manually.
Outcome: Aiming to gain more understanding of summarization systems with respect to their strengths and limitations on a fine-grained syntactic and semantic level, we use 8 major sources of errors on 10 representative summarizing models.
Diffusion Language Model with Query-Document Relevance for Query-Focused Summarization (2023.findings-emnlp)

Copied to clipboard

Challenge: Query-Focused Summarization (QFS) aims to generate summaries that address specific queries by extracting crucial information from source documents.
Approach: They propose a non-autoregressive diffusion language model that incorporates query-document fragment relevance and query-doctoral global relevance to enhance the adaptability of QFS tasks.
Outcome: The proposed model achieves state-of-the-art performance on Debatepedia and PubMedQA datasets in ROUGE scores, GPT-4, and human evaluations.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations