| Challenge: | Existing methods to discover facts from natural language text are based on relation extraction and open information extraction. |
| Approach: | They propose a task of generating a machine-readable representation of the most prominent information in a text document as a set of facts. |
| Outcome: | The proposed system outperforms baselines and text summarizers in a supervised evaluation of salience tasks. |
Similar Papers
GUM-SAGE: A Novel Dataset and Approach for Graded Entity Salience Prediction (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for graded entity salience are subjective but lack consistency. |
| Approach: | They propose a method for graded entity salience that combines subjective judgments and summarization-based methods that define saliency as mention-worthiness in a summary. |
| Outcome: | The proposed approach outperforms existing methods and shows stronger correlation with human summaries and alignments. |
Behavioral Analysis of Information Salience in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models excel at text summarization, but the exact notion of salience remains unclear. |
| Approach: | They propose a framework to derive and investigate information salience in Large Language Models (LLMs) using length-controlled summarization as a behavioral probe into the content selection process. |
| Outcome: | The proposed framework derives a proxy for how models prioritize information in large language models. |
WN-Salience: A Corpus of News Articles with Entity Salience Annotations (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing work on entity salience does not distinguish between salient and non-salient entities. |
| Approach: | They propose a dataset to measure entity salience using WikiNews dataset . WN-Salience is built on top of Wikinews, a Wikimedia project . |
| Outcome: | The proposed dataset can be used to benchmark tasks such as entity salience detection and salient entity linking. |
Leveraging Contextual Information for Effective Entity Salience Detection (2024.findings-naacl)
Copied to clipboard
Rajarshi Bhowmik, Marco Ponza, Atharva Tendle, Anant Gupta, Rebecca Jiang, Xingyu Lu, Qian Zhao, Daniel Preotiuc-Pietro
| Challenge: | Prior work on salient entity detection focused on machine learning models that require heavy feature engineering. |
| Approach: | They propose to fine-tune medium-sized language models with a cross-encoder style architecture to achieve significant performance gains over feature engineering approaches. |
| Outcome: | The proposed model fine-tunes medium-sized pre-trained language models with a cross-encoder style architecture yields substantial performance gains over feature engineering approaches. |
GUMsley: Evaluating Entity Salience in Summarization for 12 English Genres (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing work on salient entity extraction relies on crowdsourcing or user statistics to derive labels for entities. |
| Approach: | They propose a dataset that defines salience using human summaries and shows high agreement between annotations based on whether a source entity is mentioned in the summary. |
| Outcome: | The proposed dataset shows that pre-trained models and zero-shot LLM prompting fail to capture salient entities in generated summaries. |
WebIE: Faithful and Robust Information Extraction on the Web (2023.acl-long)
Copied to clipboard
| Challenge: | Existing closed IE datasets are built using Wikipedia, but they have limitations when applied to web domains. |
| Approach: | They propose to annotate 25K triples from WebIE through crowdsourcing and introduce mWebIE, a translation of the annotated set in four other languages. |
| Outcome: | The proposed model trains on 1.6M sentences from the English Common Crawl corpus and includes negative examples to better reflect the data on the web. |
Is Killed More Significant than Fled? A Contextual Model for Salient Event Detection (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on identifying the salient information in a text has used a limited representation of events that omits essential information. |
| Approach: | They propose a highly contextual model of event salience that uses a rich representation of events and integrates document-level information. |
| Outcome: | The proposed model improves on an event salience dataset by 2-4% on standard metrics and addresses flaws in existing evaluation methodologies. |
Commonsense Reasoning for Natural Language Processing (2020.acl-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will outline the various types of commonsense knowledge and discuss techniques to gather and represent commonsence knowledge. |
| Approach: | This tutorial will provide researchers with the critical foundations and recent advances in commonsense representation and reasoning. |
| Outcome: | This tutorial will outline the various types of commonsense and discuss techniques to gather and represent commonsence knowledge while highlighting the challenges specific to this type of knowledge (e.g., reporting bias). |
LSOIE: A Large-Scale Dataset for Supervised Open Information Extraction (2021.eacl-main)
Copied to clipboard
| Challenge: | Open Information Extraction (OIE) systems extract factual propositions into n-ary tuples . current datasets are limited in size and diversity . |
| Approach: | They propose to convert QA-SRL 2.0 dataset to large-scale OIE dataset LSOIE. |
| Outcome: | The proposed dataset is 20 times larger than the next largest human-annotated OIE dataset. |
Scalable Construction and Reasoning of Massive Knowledge Bases (N18-6)
Copied to clipboard
| Challenge: | Existing knowledge mining systems assume abundant human annotations for training high quality machine learning models, which is impractical when trying to deploy IE systems to a broad range of domains, settings and languages. |
| Approach: | They introduce how to extract structured facts from text corpora to construct knowledge bases. |
| Outcome: | The proposed methods are weakly-supervised and domain-independent for knowledge base construction across various domains. |