Rethinking Document-Level Relation Extraction: A Reality Check (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent efforts push up performance boundaries of document-level relation extraction (DocRE) but these efforts are not promising. |
| Approach: | They construct four types of entity mention attacks to examine model robustness . they also have a close check on model usability in a more realistic setting . |
| Outcome: | The proposed model is based on a strong or untenable assumption in common . the model is robust under four types of mention attacks and usable in a realistic setting . |
Similar Papers
Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Document-level relation extraction (DocRE) models achieve consistent performance gains in DocRE, but their underlying decision rules are still understudied. |
| Approach: | They propose to use annotations to provide rationales for document-level relation extraction (DocRE) they then propose to apply a method to evaluate models' reasoning capabilities . |
| Outcome: | The proposed models exhibit different reasoning processes in contrast to humans . the proposed models render models more trustworthy and robust to be deployed in real-world scenarios. |
On the Robustness of Document-Level Relation Extraction Models to Entity Name Variations (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing DocRE models which perform well may make more mistakes when merely changing the entity names in the document, hindering the generalization to novel entity names. |
| Approach: | They propose a pipeline to generate entity-renamed documents by replacing the original entity names with names from Wikidata. |
| Outcome: | The proposed pipeline generates entity-renamed documents by replacing the original entity names with names from Wikidata. |
Towards Integration of Discriminability and Robustness for Document-Level Relation Extraction (2023.eacl-main)
Copied to clipboard
| Challenge: | Document-level relation extraction (DocRE) predicts relations for entity pairs relying on context-dependent reasoning . a large number of annotation errors can make it difficult to distinguish large semantically close relations . |
| Approach: | They propose a loss function to improve discriminability and robustness for DocRE . they also propose supervised contrastive learning and negative label sampling strategy . |
| Outcome: | The proposed method achieves state-of-the-art results on the DocRED dataset and its recently cleaned version. |
Document-Level Relation Extraction with Global Relations and Entity Pair Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing document-level relation extraction models focus on individual entity pairs, limiting their ability to handle complex reasoning tasks. |
| Approach: | They propose a document-level relation extraction framework based on global relations and entity pair reasoning that captures fine-grained interactions between entity pairs. |
| Outcome: | The proposed framework outperforms existing models on widely-used datasets. |
DocRED: A Large-Scale Document-Level Relation Extraction Dataset (P19-1)
Copied to clipboard
Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, Maosong Sun
| Challenge: | Existing relation extraction methods focus on extracting intra-sentence relations for single entities. |
| Approach: | They propose a relation extraction dataset from Wikipedia and Wikidata with three features . document-level relation extraction is a task to identify relational facts between entities . |
| Outcome: | The proposed dataset is the largest human-annotated dataset for document-level RE from plain text. |
Not Just Plain Text! Fuel Document-Level Relation Extraction with Explicit Syntax Refinement and Subsentence Modeling (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Document-level relation extraction (DocRE) aims to identify semantic labels among entities within a document. |
| Approach: | They propose a document-level relation extraction framework that captures and exploits instructive information by adding extra syntactic information into text representations. |
| Outcome: | The proposed framework outperforms existing methods on three benchmark datasets. |
AutoRE: Document-Level Relation Extraction with Large Language Models (2024.acl-demos)
Copied to clipboard
| Challenge: | Existing methods for relation extraction are limited to Sentence-level Relation Extraction (SentRE) tasks. |
| Approach: | They propose an end-to-end DocRE model that adopts a novel RE extraction paradigm named RHF (Relation-Head-Facts) Unlike existing approaches, AutoRE does not rely on the assumption of known relation options, making it more reflective of real-world scenarios. |
| Outcome: | The proposed model surpasses TAG by 10.03% and 9.03% on the dev and test set. |
Relation-Specific Attentions over Entity Mentions for Enhanced Document-Level Relation Extraction (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing document-level relation extraction methods do not distinguish between mention-level features and entity-level feature . document-based methods are more challenging because of multiple mentions of entities. |
| Approach: | They propose a method which selectively attentions different entity mentions with respect to candidate relations and performs relation-specific representations of entities. |
| Outcome: | The proposed method improves relation-specific representations of entities on two benchmark datasets. |
An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learning (2021.eacl-main)
Copied to clipboard
| Challenge: | Using a multi-task approach, we extract facts from documents at entity level. |
| Approach: | They propose a multi-task approach that builds upon coreference resolution and gathers relevant signals via multi-instance learning with multi-level representations combining global entity and local mention information. |
| Outcome: | The proposed model is on par with task-specific learning, though more efficient due to shared parameters and training steps. |
DORE: Document Ordered Relation Extraction based on Generative Framework (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing generative methods do not fit document-level relation extraction tasks where there are multiple entities and relational facts. |
| Approach: | They propose to generate a symbolic and ordered sequence from relation matrix which is easier to learn and introduce several negative sampling strategies to improve the performance with balanced signals. |
| Outcome: | The proposed method can improve the performance of the generative DocRE models on four datasets. |