Can LLMs be Good Graph Judge for Knowledge Graph Construction? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for converting unstructured text into structured Knowledge Graphs (KGs) have limitations such as large amount of noise, inaccurate knowledge, and hallucination . |
| Approach: | They propose a GraphJudge framework to reduce noise in real-world documents . they propose Graphjudge to fine-tune a LLM as a graph judge to enhance quality . |
| Outcome: | The proposed framework eliminates noise in real-world documents and improves the quality of generated KGs. |
Similar Papers
LLMs as Knowledge Graph Refiners: Mitigating Factual Inconsistencies in Generative Knowledge Extraction (2026.acl-long)
Copied to clipboard
| Challenge: | Knowledge graphs (KGs) represent real-world entities and their relations in a structured form. |
| Approach: | They propose a framework that performs triple-level refinement on KGs constructed via GKE. |
| Outcome: | The proposed framework improves KG quality from diverse perspectives. |
Tree-KG: An Expandable Knowledge Graph Construction Framework for Knowledge-intensive Domains (2025.acl-long)
Copied to clipboard
| Challenge: | Knowledge graphs are a useful tool for organizing complex data in knowledge-intensive domains. |
| Approach: | They propose an expandable framework that combines structured domain texts with advanced semantic techniques to create a tree-like graph from textbooks. |
| Outcome: | The proposed framework surpasses competing methods in the text-Annotated dataset with high scores on the Text-Annalytated data. |
KG-GPT: A General Framework for Reasoning on Knowledge Graphs Using Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Using large language models for complex reasoning tasks on knowledge graphs remains unexplored. |
| Approach: | They propose a multi-purpose framework leveraging large language models for complex reasoning tasks on knowledge graphs. |
| Outcome: | The proposed framework outperforms fully-supervised models in KG-based fact verification and KGQA benchmarks. |
Generating Domain-Specific Knowledge Graphs from Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown impressive world knowledge across different benchmarks and domains but their knowledge is inconveniently scattered across their billions of parameters. |
| Approach: | They propose a prompt-based method to extract knowledge solely from LLMs’ parameters to construct domain-specific KGs by a schema-based process. |
| Outcome: | The proposed method generates large domain-specific KGs containing tens of thousands of entities and relations, and then evaluates against Wikidata, an open-source human-created KG. |
Fact Finder - Enhancing Domain Expertise of Large Language Models by Incorporating Knowledge Graphs (2026.eacl-demo)
Copied to clipboard
Daniel Steinigen, Roman Teucher, Timm Heine Ruland, Max Rudat, Nicolas Flores-Herr, Peter Fischer, Nikola Milosevic, Christopher Schymura, Angelo Ziletti
| Challenge: | Recent advances in Large Language Models have demonstrated their proficiency in answering natural language queries. |
| Approach: | They propose a system that augments Large Language Models with domain-specific knowledge graphs . they evaluate a medical KG and use a KG-based retrieval approach to enhance factual correctness . |
| Outcome: | The proposed system surpasses a standalone LLM in accuracy and completeness on a medical KG dataset. |
HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to answer multi-hop questions are query-agnostic and the extracted facts are ambiguous as they lack context. |
| Approach: | They propose to use a knowledge graph to extract query-relevant information from unstructured text. |
| Outcome: | The proposed method achieves performance improvements on two popular datasets. |
Retrieval and Reasoning on KGs: Integrate Knowledge Graphs into Large Language Models for Complex Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have performed impressively in various NLP tasks, but their inherent hallucination phenomena severely challenge their credibility in complex reasoning. |
| Approach: | They propose to integrate explainable Knowledge Graphs (KGs) with LLMs to alleviate hallucinations . they construct subgraphs to enhance the retrieval capabilities of KGs via CoT reasoning. |
| Outcome: | Extensive experiments on two KGQA datasets show that the proposed model achieves convincing performance compared to strong baselines. |
SocraticKG: Knowledge Graph Construction via QA-Driven Fact Extraction (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to construct knowledge graphs struggle with factual coverage and information loss. |
| Approach: | They propose an automated KG construction method that introduces question-answer pairs as a structured intermediate representation to unfold document-level semantics prior to triple extraction. |
| Outcome: | The proposed method achieves superior factual retention while maintaining high structural cohesion even as extracted knowledge volume substantially expands. |
SAC-KG: Exploiting Large Language Models as Skilled Automatic Constructors for Domain Knowledge Graph (2024.acl-long)
Copied to clipboard
| Challenge: | Existing KG construction methods rely on human intervention to attain qualified KGs, which severely hinders the practical application of domain KG. |
| Approach: | They propose a general KG construction framework that uses large language models as "S**killed" A**utomatic C**onstructors for domain knowledge (G**raph) |
| Outcome: | The proposed framework generates specialized multi-level knowledge graphs at the scale of over one million nodes and achieves 89.32% precision rate compared to state-of-the-art methods. |
DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text (2024.findings-naacl)
Copied to clipboard
| Challenge: | Retrievalaugmented LLMs have been used to ground LLM in external knowledge . a gap exists in the current landscape regarding the effectiveness of grounding LLM on heterogeneous knowledge sources. |
| Approach: | They propose a model that uses symbolic language to generate symbolic queries . they use a dataset that is generated using predefined reasoning chains and human annotation . |
| Outcome: | The proposed model outperforms previous approaches by a significant margin in QA tasks over text. |