A Variational Approach for Mitigating Entity Bias in Relation Extraction (2025.acl-short)
Copied to clipboard
| Challenge: | Relation Extraction (RE) models often rely excessively on entities, resulting in poor generalization. |
| Approach: | They propose a Variational Information Bottleneck (VIB) framework to reduce entity bias in Relation Extraction (RE) . their method extracts relational information from unstructured data to improve generalization . |
| Outcome: | The proposed method achieves state-of-the-art on general and financial domain RE datasets, excelling in in-domain settings and out-of domain. |
Similar Papers
Should We Rely on Entity Mentions for Relation Extraction? Debiasing Relation Extraction with Counterfactual Analysis (2022.naacl-main)
Copied to clipboard
Yiwei Wang, Muhao Chen, Wenxuan Zhou, Yujun Cai, Yuxuan Liang, Dayiheng Liu, Baosong Yang, Juncheng Liu, Bryan Hooi
| Challenge: | Existing studies rely on entity information for sentence-level relation extraction (RE) but this can leak superficial and spurious clues of relations. |
| Approach: | They propose to use entity mentions to extract relations from textual context . they use a causal graph to model dependencies between variables in RE models . |
| Outcome: | The proposed method yields significant gains on both effectiveness and generalization for RE. |
Towards Building More Robust NER datasets: An Empirical Study on NER Dataset Bias from a Dataset Difficulty View (2023.emnlp-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) models rely on superficial entity patterns for predictions, without considering evidence from the context. |
| Approach: | They propose to de-bias NER datasets by altering entity-context distribution . they also validate the feasibility of the proposed de-bianking techniques . |
| Outcome: | The proposed methods can be applied to different models and improve existing models. |
Towards Integration of Discriminability and Robustness for Document-Level Relation Extraction (2023.eacl-main)
Copied to clipboard
| Challenge: | Document-level relation extraction (DocRE) predicts relations for entity pairs relying on context-dependent reasoning . a large number of annotation errors can make it difficult to distinguish large semantically close relations . |
| Approach: | They propose a loss function to improve discriminability and robustness for DocRE . they also propose supervised contrastive learning and negative label sampling strategy . |
| Outcome: | The proposed method achieves state-of-the-art results on the DocRED dataset and its recently cleaned version. |
De-Bias for Generative Extraction in Unified NER Task (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for Named entity recognition (NER) are not consistent with the task, which makes the model vulnerable to incorrect biases. |
| Approach: | They propose to use generative model to recognize entities from sentences . they analyze incorrect biases in the generation process from a causal perspective . |
| Outcome: | The proposed method improves the performance of the generative NER model in various datasets. |
Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition (2021.tacl-1)
Copied to clipboard
| Challenge: | Name Regularity Bias is a problem in NER models that use contextual information to predict the type of an ambiguous entity. |
| Approach: | They propose a model-agnostic training method that adds learnable adversarial noise to some entity mentions to improve their accuracy. |
| Outcome: | The proposed method outperforms feature-based models on name regularity bias . it adds learnable adversarial noise to some entity mentions, leading to gains . |
On the Robustness of Document-Level Relation Extraction Models to Entity Name Variations (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing DocRE models which perform well may make more mistakes when merely changing the entity names in the document, hindering the generalization to novel entity names. |
| Approach: | They propose a pipeline to generate entity-renamed documents by replacing the original entity names with names from Wikidata. |
| Outcome: | The proposed pipeline generates entity-renamed documents by replacing the original entity names with names from Wikidata. |
A Causal View of Entity Bias in (Large) Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Entity bias affects pretrained (large) language models, causing them to rely on (biased) parametric knowledge to make unfaithful predictions. |
| Approach: | They propose a structured causal model whose parameters are easier to estimate . they propose to perturb the original entity with neighboring entities . |
| Outcome: | The proposed model reduces biasing information pertaining to the original entity while still preserving sufficient semantic information from similar entities. |
Relation-Specific Attentions over Entity Mentions for Enhanced Document-Level Relation Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing document-level relation extraction methods do not distinguish between mention-level features and entity-level feature . document-based methods are more challenging because of multiple mentions of entities. |
| Approach: | They propose a method which selectively attentions different entity mentions with respect to candidate relations and performs relation-specific representations of entities. |
| Outcome: | The proposed method improves relation-specific representations of entities on two benchmark datasets. |
ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit remarkable adaptability across domains, but they are often not suitable for structured knowledge extraction tasks such as named entity recognition (NER). |
| Approach: | They propose a method that instructs LLMs to self-reflect on the specific domain and generates domain-relevant attributes for creating attribute-rich training data. |
| Outcome: | The proposed method produces NER datasets in domains with domain-relevant attributes and generates entity terms and NER context data around these entities. |
Learning from Noisy Labels for Entity-Centric Information Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent information extraction approaches can easily overfit noisy labels and suffer from performance degradation. |
| Approach: | They propose a co-regularization framework for entity-centric information extraction that optimizes neural models with task-specific losses and regularizes them to generate similar predictions based on agreement loss. |
| Outcome: | The proposed framework is optimized with task-specific losses and generates similar predictions based on agreement loss. |