Generate-on-Graph: Treat LLM as both Agent and KG for Incomplete Knowledge Graph Question Answering (2024.emnlp-main)
Copied to clipboard
Yao Xu, Shizhu He, Jiabei Chen, Zihao Wang, Yangqiu Song, Hanghang Tong, Guang Liu, Jun Zhao, Kang Liu
| Challenge: | Existing methods to integrate LLMs with Knowledge Graphs (KGs) however, these methods are often incomplete to cover all the knowledge required to answer questions. |
| Approach: | They propose to integrate LLMs with Knowledge Graphs (KGs) to address insufficient knowledge and hallucination issues in Large Language Models. |
| Outcome: | The proposed method outperforms existing methods on two datasets. |
Similar Papers
KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to design the interaction strategy between large language models and knowledge graphs (KGs) are not effective for large language model (LLM)s to solve complex tasks due to the large volume and structured format of KG data. |
| Approach: | They propose an LLM-based agent framework that enables small LLMs to actively make decisions over knowledge graphs. |
| Outcome: | The proposed framework outperforms existing methods on in-domain and out-domain datasets using 10K samples. |
Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunities (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown remarkable performance on question-answering tasks due to their superior capabilities in natural language understanding and generation. |
| Approach: | They propose a structured taxonomy that categorizes the methodology of synthesizing LLMs and knowledge graphs for QA according to the categories of QA and the KG’s role when integrating with LLM. |
| Outcome: | The proposed taxonomy categorizes the methods according to the categories of QA and the KG’s role when integrating with LLMs. |
Retrieval and Reasoning on KGs: Integrate Knowledge Graphs into Large Language Models for Complex Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have performed impressively in various NLP tasks, but their inherent hallucination phenomena severely challenge their credibility in complex reasoning. |
| Approach: | They propose to integrate explainable Knowledge Graphs (KGs) with LLMs to alleviate hallucinations . they construct subgraphs to enhance the retrieval capabilities of KGs via CoT reasoning. |
| Outcome: | Extensive experiments on two KGQA datasets show that the proposed model achieves convincing performance compared to strong baselines. |
Leveraging LLM-GNN Integration for Open-World Question Answering over Knowledge Graphs (2026.eacl-long)
Copied to clipboard
| Challenge: | Traditional KGQA assumes a closed world where answers must exist in the KG, limiting real-world applicability. |
| Approach: | They propose a system that combines a pre-trained GNN and an LLM for open-world QA. |
| Outcome: | The proposed system outperforms existing LLM–GNN systems on standard benchmarks and GLOW-BENCH, achieving up to 53.3% and an average 38% improvement. |
Can Knowledge Graphs Make Large Language Models More Trustworthy? An Empirical Study Over Open-ended Question Answering (2025.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for integrating Knowledge Graphs with Large Language Models focus on closed-ended tasks, leaving a gap in evaluating performance on more complex, real-world scenarios. |
| Approach: | They propose a benchmark to evaluate LLMs augmented with KGs in open-ended, real-world question answering settings. |
| Outcome: | The proposed benchmark reflects practical complexities through diverse question types and incorporates metrics to quantify both hallucination rates and reasoning improvements in LLM+KG models. |
Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completion (2025.coling-main)
Copied to clipboard
| Challenge: | Empirical evidence suggests that LLMs perform worse than conventional KGC approaches. |
| Approach: | They propose a filter-then-generate paradigm and a multiple-choice question format to harness the capability of LLMs while mitigating the issue casused by hallucinations. |
| Outcome: | The proposed method achieves substantial performance gain compared to existing state-of-the-art methods. |
CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph (2024.acl-demos)
Copied to clipboard
| Challenge: | Large language models (LLMs) are susceptible to generating hallucinated content and often encompass factually inaccurate information. |
| Approach: | They propose a framework that leverages knowledge graphs to address the limitations of Large Language Models (LLMs) they identify and decompose required knowledge triples that are not present in the KG, enriching them and aligning updates with real-world demands. |
| Outcome: | The proposed framework reduces hallucinations and increases factual accuracy in QA scenarios while retaining the same quality of knowledge. |
DARA: Decomposition-Alignment-Reasoning Autonomous Language Agent for Question Answering over Knowledge Graphs (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to answer questions over Knowledge Graphs (KGQA) are not available for KGQA. |
| Approach: | They propose a framework to improve the neural-symbolic reasoning capabilities of language agents powered by Large Language Models (LLMs) they show that DARA can be efficiently trained with a small number of high-quality reasoning trajectories. |
| Outcome: | The proposed framework outperforms in-context learning-based agents with GPT-4 and alternative fine-tuned agents across different benchmarks. |
Augmenting Reasoning Capabilities of LLMs with Graph Structures in Knowledge Base Question Answering (2024.findings-emnlp)
Copied to clipboard
Yuhang Tian, Dandan Song, Zhijing Wu, Changzhi Zhou, Hao Wang, Jun Yang, Jing Xu, Ruanmin Cao, HaoYu Wang
| Challenge: | Recent work uses Large Language Models (LLMs) for semantic parsing to address Knowledge Base Question Answering tasks. |
| Approach: | They propose a framework that augments reasoning capabilities of LLMs with Graph Structures in Knowledge Base Question Answering to retrieve question-related graph structures. |
| Outcome: | The proposed framework outperforms existing methods on GrailQA and WebQSP under the few-shot setting. |
Enrich-on-Graph: Query-Graph Alignment for Complex Reasoning with LLM Enriching (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods employ resource-intensive, non-scalable workflows reasoning on vanilla KGs, but overlook this gap. |
| Approach: | They propose a flexible framework that leverages LLMs’ prior knowledge to enrich KGs and bridge the semantic gap between queries and graphs. |
| Outcome: | The proposed framework bridges the semantic gap between structured knowledge graphs and unstructured queries while ensuring low computational costs, scalability, and adaptability across different methods. |