| Challenge: | Open Information Extraction (OIE) methods extract facts in the form of triples . ambiguity of these triples hinders their downstream usage . |
| Approach: | They propose a benchmark that measures fact linking performance on a granular triple slot level . they propose to use a system that can detect out-of-KG entities and predicates . |
| Outcome: | The proposed benchmark can measure fact linking performance on a granular triple slot level while also measuring if a system can recognize that a surface form has no match in the existing KG. |
Similar Papers
CaRe: Open Knowledge Graph Embeddings (D19-1)
Copied to clipboard
| Challenge: | Existing methods for generating Open Knowledge Graphs have been criticized for not achieving canonicalization of OpenKGs. |
| Approach: | They propose to use Open Information Extraction methods to extract triples from text . they propose to learn embeddings of NPs and RPs present in the graph . |
| Outcome: | The proposed methods improve OpenKG embeddings and bootstrap OpenKGs from text corpus. |
OpenCeres: When Open Information Extraction Meets the Semi-Structured Web (N19-1)
Copied to clipboard
| Challenge: | Open Information Extraction (OpenIE) is a problem of extracting triples from natural language text whose predicate relations are not aligned to any pre-defined ontology. |
| Approach: | They propose an open-source method to extract triples from semi-structured websites . they use a semi-supervised label propagation technique to create training data for relations . |
| Outcome: | The proposed method extracts over 2 million triples from 31 websites in the movie vertical. |
BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for OIE are incomplete and do not include all acceptable variants of the same fact. |
| Approach: | They introduce BenchIE: a benchmark and evaluation framework for comprehensive evaluation of OIE systems for English, Chinese, and German. |
| Outcome: | The proposed framework is based on fact synsets, clusters, and standardized benchmarks. |
LLMs as Knowledge Graph Refiners: Mitigating Factual Inconsistencies in Generative Knowledge Extraction (2026.acl-long)
Copied to clipboard
| Challenge: | Knowledge graphs (KGs) represent real-world entities and their relations in a structured form. |
| Approach: | They propose a framework that performs triple-level refinement on KGs constructed via GKE. |
| Outcome: | The proposed framework improves KG quality from diverse perspectives. |
Can We Predict New Facts with Open Knowledge Graph Embeddings? A Benchmark for Open Link Prediction (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for predicting knowledge graphs rely on the rich structure of the knowledge graph. |
| Approach: | They propose an evaluation protocol and a methodology for creating the open link prediction benchmark OlpBench. |
| Outcome: | The proposed model predicts test facts by completing questions in open link prediction task. |
OpenKI: Integrating Open Information Extraction and Knowledge Bases with Relation Inference (N19-1)
Copied to clipboard
| Challenge: | Existing methods for knowledge extraction and alignment are limited in quality and performance. |
| Approach: | They propose to integrate OpenIE extractions in the form of (subject, predicate, object) triples with Knowledge Bases (KB) |
| Outcome: | The proposed method improves state-of-the-art for OpenIE extractions and boosts performance on OpenIE from semi-structured data. |
AnnIE: An Annotation Platform for Constructing Complete Open Information Extraction Benchmark (2022.acl-demo)
Copied to clipboard
Niklas Friedrich, Kiril Gashteovski, Mingying Yu, Bhushan Kotnis, Carolin Lawrence, Mathias Niepert, Goran Glavaš
| Challenge: | Open Information Extraction (OIE) is the task of extracting facts from sentences in the form of relations and their corresponding arguments in schema-free manner. |
| Approach: | They propose an interactive annotation platform that facilitates annotating complete facts from input sentences. |
| Outcome: | The proposed platform facilitates such challenging annotation tasks and supports creation of fact-oriented OIE evaluation benchmarks. |
Wikontic: Constructing Wikidata-Aligned, Ontology-Aware Knowledge Graphs with Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Knowledge graphs provide structured, verifiable grounding for large language models . current LLMs use KGs as auxiliary structures for text retrieval . |
| Approach: | They propose a pipeline that constructs KGs from open-domain texts using triplets and qualifiers. |
| Outcome: | The proposed pipeline outperforms existing methods in retrieval-augmented generation. |
FactKG: Fact Verification via Reasoning on Knowledge Graphs (2023.acl-long)
Copied to clipboard
| Challenge: | knowledge graphs (KGs) have not been fully utilized as a knowledge source for fact verification. |
| Approach: | They propose a dataset to enable the community to better use knowledge graphs . they propose 108k natural language claims with five types of reasoning . |
| Outcome: | The proposed dataset consists of 108k natural language claims with five types of reasoning . authors believe the proposed method can advance reliability and practicality . |
Direct Fact Retrieval from Knowledge Graphs without Entity Linking (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to retrieve facts from Knowledge Graphs (KGs) require additional labels and may accumulate errors . |
| Approach: | They propose a framework that directly retrieves facts from KGs given input text based on their representational similarities. |
| Outcome: | The proposed framework outperforms baselines on multiple fact retrieval tasks. |