GUM-SAGE: A Novel Dataset and Approach for Graded Entity Salience Prediction (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for graded entity salience are subjective but lack consistency. |
| Approach: | They propose a method for graded entity salience that combines subjective judgments and summarization-based methods that define saliency as mention-worthiness in a summary. |
| Outcome: | The proposed approach outperforms existing methods and shows stronger correlation with human summaries and alignments. |
Similar Papers
GUMsley: Evaluating Entity Salience in Summarization for 12 English Genres (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing work on salient entity extraction relies on crowdsourcing or user statistics to derive labels for entities. |
| Approach: | They propose a dataset that defines salience using human summaries and shows high agreement between annotations based on whether a source entity is mentioned in the summary. |
| Outcome: | The proposed dataset shows that pre-trained models and zero-shot LLM prompting fail to capture salient entities in generated summaries. |
Leveraging Contextual Information for Effective Entity Salience Detection (2024.findings-naacl)
Copied to clipboard
Rajarshi Bhowmik, Marco Ponza, Atharva Tendle, Anant Gupta, Rebecca Jiang, Xingyu Lu, Qian Zhao, Daniel Preotiuc-Pietro
| Challenge: | Prior work on salient entity detection focused on machine learning models that require heavy feature engineering. |
| Approach: | They propose to fine-tune medium-sized language models with a cross-encoder style architecture to achieve significant performance gains over feature engineering approaches. |
| Outcome: | The proposed model fine-tunes medium-sized pre-trained language models with a cross-encoder style architecture yields substantial performance gains over feature engineering approaches. |
WN-Salience: A Corpus of News Articles with Entity Salience Annotations (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing work on entity salience does not distinguish between salient and non-salient entities. |
| Approach: | They propose a dataset to measure entity salience using WikiNews dataset . WN-Salience is built on top of Wikinews, a Wikimedia project . |
| Outcome: | The proposed dataset can be used to benchmark tasks such as entity salience detection and salient entity linking. |
“Will You Find These Shortcuts?” A Protocol for Evaluating the Faithfulness of Input Salience Methods for Text Classification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on faithfulness evaluation is not conclusive and does not provide a clear answer as to how different methods are to be compared. |
| Approach: | They propose a protocol for faithfulness evaluation that makes use of partially synthetic data to obtain ground truth for feature importance ranking. |
| Outcome: | The proposed method is based on partially synthetic data and is compared with lexical shortcuts on a range of datasets and LSTM models. |
Predicting Entity Salience in Extremely Short Documents (2024.emnlp-industry)
Copied to clipboard
| Challenge: | False positive: ES is a natural language understanding task that determines which entities are most salient to a passage . Falsity: Popsicle, Frank Epperson and San Francisco are salient entities . |
| Approach: | They propose a lightweight and data-efficient approach for entity salience detection on short documents . they propose he use of a human-labeled dataset to evaluate entity salient on short questions . |
| Outcome: | The proposed approach achieves competitive performance over state-of-the-art models at significant cost and latency advantages. |
SegDRE: A Salient Entity Guided Approach to Document-Level Relation Extraction (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing models struggle to address two major bottlenecks in Document-level Relation Extraction: extreme class imbalance and complexity of multi-hop reasoning. |
| Approach: | They propose a method that decouples the extraction space into dense and sparse scenarios. |
| Outcome: | The proposed approach yields consistent improvements over various backbone models and achieves advanced performance compared to existing enhancement methods. |
Behavioral Analysis of Information Salience in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models excel at text summarization, but the exact notion of salience remains unclear. |
| Approach: | They propose a framework to derive and investigate information salience in Large Language Models (LLMs) using length-controlled summarization as a behavioral probe into the content selection process. |
| Outcome: | The proposed framework derives a proxy for how models prioritize information in large language models. |
Facts That Matter (D18-1)
Copied to clipboard
| Challenge: | Existing methods to discover facts from natural language text are based on relation extraction and open information extraction. |
| Approach: | They propose a task of generating a machine-readable representation of the most prominent information in a text document as a set of facts. |
| Outcome: | The proposed system outperforms baselines and text summarizers in a supervised evaluation of salience tasks. |
Improving Fine-grained Entity Typing with Entity Linking (D19-1)
Copied to clipboard
| Challenge: | Existing methods for fine-grained entity typing require a large tag set and knowledge of the context. |
| Approach: | They propose a deep neural model that uses context and information from entity linking to improve fine-grained entity typing. |
| Outcome: | The proposed model achieves 5% absolute strict accuracy improvement over the state of the art on two datasets. |
Ranking Entities along Conceptual Space Dimensions with LLMs: An Analysis of Fine-Tuning Strategies (2024.findings-acl)
Copied to clipboard
| Challenge: | Conceptual spaces represent entities in terms of their primitive semantic features. |
| Approach: | They argue that conceptual spaces should be used alongside knowledge graphs in many settings to model entities in terms of their primitive semantic features. |
| Outcome: | The proposed model can rank entities according to a given conceptual space dimension but ground truth rankings for conceptual space dimensions are rare. |