Automatic Error Analysis for Document-level Information Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Document-level information extraction (IE) tasks have been revisited in earnest . evaluation of the approaches has been limited in a number of dimensions . |
| Approach: | They propose a transformation-based framework for automating error analysis in document-level event and (N-ary) relation extraction. |
| Outcome: | The proposed framework compares two state-of-the-art document-level template-filling approaches on datasets from three domains and four systems from the MUC-4 evaluation. |
Similar Papers
SciREX: A Challenge Dataset for Document-Level Information Extraction (2020.acl-main)
Copied to clipboard
| Challenge: | Conventional datasets and methods for information extraction focus on within-sentence relations from general Newswire text. |
| Approach: | They propose a document-level IE dataset that integrates automatic and human annotations to annotate entities and document- level N-ary relation identification from scientific articles. |
| Outcome: | The proposed dataset extends state-of-the-art IE models to document-level IE. |
On Event Individuation for Document-Level Information Extraction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a bomb exploded in a restaurant in Lima, and a second device was deactivated by the police . |
| Approach: | They argue that the task demands definitive answers to thorny questions of *event individuation* they argue that even human experts disagree on the task . |
| Outcome: | The proposed task demands definitive answers to thorny questions of *event individuation* . the proposed task also raises concerns about the usefulness of template filling metrics . |
A Survey on Open Information Extraction (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to open information extraction (Open IE) focus on narrow, well-defined requests over a predefined set of target relations on small, homogeneous corpora. |
| Approach: | They propose to use unsupervised methods to extract all types of relations found in text . they propose to implement a system that can be automated to detect possible relations . |
| Outcome: | The proposed approaches have been compared with existing methods and are based on the results of a literature review. |
Document-level Entity-based Extraction as Template Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Document-level entity-based extraction (EE) tasks extract entity-centric information from unstructured text across multiple sentences. |
| Approach: | They propose a generative framework for two document-level EE tasks: role-filler entity extraction (RE) and relation extraction ( RE). |
| Outcome: | The proposed framework captures cross-entity dependencies and avoids exponential computation complexity of identifying N-ary relations. |
Easy-to-Hard Learning for Information Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for information extraction (IE) use a one-stage learning strategy to extract the target structure from unstructured text data. |
| Approach: | They propose a unified easy-to-hard learning framework that mimics the human learning process by breaking down the learning process into multiple stages. |
| Outcome: | The proposed framework enables the model to acquire general IE task knowledge and improve its generalization ability on 13 out of 17 datasets. |
Document-Level Event Argument Extraction by Conditional Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing event extraction models have been limited to the sentence level . this formulation signifies a misalignment between the information seeking behavior and the informative seeking behavior. |
| Approach: | They propose a document-level neural event argument extraction model by formulating the task as conditional generation following event templates. |
| Outcome: | The proposed model achieves 7.6% F1 and 5.7% F1 over the best baseline on the document-level event extraction dataset WikiEvents and 9.3% F1 on the informative argument extraction task. |
Measurement Extraction with Natural Language Processing: A Review (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Information extraction (IE) is a task in natural language processing that extracts information from documents. |
| Approach: | They describe different approaches to measurement extraction and outline challenges posed by this task. |
| Outcome: | The proposed methods are compared with the literature on the extraction of quantitative data from documents. |
ADAPTIVE IE: Investigating the Complementarity of Human-AI Collaboration to Adaptively Extract Information on-the-fly (2025.coling-main)
Copied to clipboard
Ishani Mondal, Michelle Yuan, Anandhavelu N, Aparna Garimella, Francis Ferraro, Andrew Blair-Stanek, Benjamin Van Durme, Jordan Boyd-Graber
| Challenge: | Existing IE systems are either fully supervised, requiring expensive human annotations, or fully unsupervised, extracting information that often do not cater to user’s needs. |
| Approach: | They propose a framework that uses human-in-the-loop refinement to adapt to changing user questions. |
| Outcome: | The proposed framework is domain-agnostic, responsive, efficient for helping users access useful information while quickly reorganizing information in response to evolving information needs. |
AutoRE: Document-Level Relation Extraction with Large Language Models (2024.acl-demos)
Copied to clipboard
| Challenge: | Existing methods for relation extraction are limited to Sentence-level Relation Extraction (SentRE) tasks. |
| Approach: | They propose an end-to-end DocRE model that adopts a novel RE extraction paradigm named RHF (Relation-Head-Facts) Unlike existing approaches, AutoRE does not rely on the assumption of known relation options, making it more reflective of real-world scenarios. |
| Outcome: | The proposed model surpasses TAG by 10.03% and 9.03% on the dev and test set. |
Global-to-Local Neural Networks for Document-Level Relation Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Relation extraction (RE) aims to identify the semantic relations between named entities in text. |
| Approach: | They propose a novel relation extraction model that encodes document information in terms of entity global and local representations and context relation representations. |
| Outcome: | The proposed model achieves superior performance on two public datasets for document-level RE. |