| Challenge: | Open information extraction (IE) is the task of extracting open-domain assertions from natural language sentences. |
| Approach: | They propose an additional binary classification loss to calibrate the extraction likelihood . they propose an iterative learning process where extractions generated by the open IE model are incrementally included as training samples to help the model learn from trial and error. |
| Outcome: | Experiments on open information extraction (IE) show that the extraction likelihood is not well calibrated when comparing quality of extracted assertions. |
Similar Papers
Supervised Open Information Extraction (N18-1)
Copied to clipboard
| Challenge: | Existing methods for Open Information Extraction (Open IE) use semisupervised approaches or rule-based algorithms. |
| Approach: | They propose a supervised approach to Open Information Extraction (Open IE) they build on recent deep Semantic Role Labeling models to extract Open IE tuples . |
| Outcome: | The proposed model outperforms state-of-the-art Open IE systems on benchmark datasets. |
Syntactically Rich Discriminative Training: An Effective Method for Open Information Extraction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Open information extraction (OIE) is the task of extracting facts from natural language text. |
| Approach: | They propose a method for computing syntactically rich text embeddings using the structure of dependency trees and a discriminative approach to OIE where tokens in the generated fact are classified as "real" and "fake" they propose to reduce repetitive tokens and improve models' ability to generate implicit facts by a factor of 23%. |
| Outcome: | The proposed method reduces repetitive tokens by a factor of 23% on the CaRB, OIE2016, and LSOIE datasets and improves on augmented datasets. |
Efficient Data Learning for Open Information Extraction with Pre-trained Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results indicate that, compared to previous SOTA methods, OK-IE requires only 1/100 of the training data (900 instances) and 1/120 of the time (3 minutes) to achieve comparable results. |
| Approach: | They propose a framework that transforms OpenIE into the pre-training task form of the T5 model, thereby reducing the need for extensive training data. |
| Outcome: | The proposed framework transforms OpenIE into the pre-training task form of the T5 model, reducing the need for extensive training data and significantly reducing training time. |
IELM: An Open Information Extraction Benchmark for Pre-Trained Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show pre-trained LMs store linguistic and relational knowledge . pre-training LM models can answer "fill-in-the-blank" questions based on pre-defined relations . |
| Approach: | They propose an open information extraction benchmark for pre-trained language models . they turn pre-trained LMs into zero-shot OIE systems to examine open relational information . |
| Outcome: | The proposed benchmark outperforms state-of-the-art methods on factual OIE datasets without training sets. |
Syntactic and Semantic-driven Learning for Open Information Extraction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that our approach significantly outperforms the supervised counterparts, and can even achieve competitive performance to supervised state-of-the-art (SoA) model. |
| Approach: | They propose a syntactic and semantic-driven learning approach that can learn open IE models without human-labelled data by leveraging syntakic and semantic knowledge as noisier, higher-level supervision. |
| Outcome: | The proposed approach outperforms supervised counterparts and can achieve competitive performance to supervised state-of-the-art models. |
A Survey on Open Information Extraction (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to open information extraction (Open IE) focus on narrow, well-defined requests over a predefined set of target relations on small, homogeneous corpora. |
| Approach: | They propose to use unsupervised methods to extract all types of relations found in text . they propose to implement a system that can be automated to detect possible relations . |
| Outcome: | The proposed approaches have been compared with existing methods and are based on the results of a literature review. |
Neural Open Information Extraction (P18-2)
Copied to clipboard
| Challenge: | Existing Open IE systems are built on hand-crafted patterns from syntactic parsing, yet they face errors in propagation and compounding at each stage. |
| Approach: | They propose a neural Open IE approach with an encoder-decoder framework . they propose to learn highly confident arguments and relation tuples bootstrapped from a state-of-the-art Open ie system. |
| Outcome: | The proposed approach outperforms baseline methods while maintaining comparable computational efficiency. |
Systematic Comparison of Neural Architectures and Training Approaches for Open Information Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Open information extraction (OIE) is a method for extracting facts from text in structured format . alternative formulations allow for longer tuples, but most work focuses on binary predicates only. |
| Approach: | They propose to extract facts from natural language text and represent them as structured triples . they compare different neural network architectures and training approaches . |
| Outcome: | The proposed approach improves the currently best models on the OIE16 benchmark by 0.421 F1 score and 0.420 AUC-PR . |
Supervising Unsupervised Open Information Extraction Models (D19-1)
Copied to clipboard
| Challenge: | Existing supervised methods that use labeled training data are expensive and difficult to adapt to new domains. |
| Approach: | They propose a supervised open information extraction framework that leverages unsupervised Open IE systems and labeled data to improve system performance. |
| Outcome: | The proposed method outperforms existing supervised and unsupervised models by a significant margin. |
Open Information Extraction on Scientific Text: An Evaluation (C18-1)
Copied to clipboard
| Challenge: | Open Information Extraction (OIE) is the unsupervised creation of structured information from text. |
| Approach: | They propose to use two state-of-the-art OIE systems to evaluate the performance of OIE on scientific texts originating from 10 different disciplines. |
| Outcome: | The proposed methods perform significantly worse on scientific text than encyclopedic text. |