Challenge: Existing research on the utilization of Knowledge Graphs (KGs) for large language models (LLMs) relies on subgraph retriever or iterative prompting, overlooking the potential synergy of LLMs’ step-wise reasoning capabilities and KGs’ structural nature.
Approach: They propose a graph-aware constrained decoding framework that facilitates a deep synergy between LLMs and KGs by constraint derived from the topology of the KG.
Outcome: The proposed framework can provide faithful and sound reasoning for KGQA.

Similar Papers

Retrieval and Reasoning on KGs: Integrate Knowledge Graphs into Large Language Models for Complex Question Answering (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have performed impressively in various NLP tasks, but their inherent hallucination phenomena severely challenge their credibility in complex reasoning.
Approach: They propose to integrate explainable Knowledge Graphs (KGs) with LLMs to alleviate hallucinations . they construct subgraphs to enhance the retrieval capabilities of KGs via CoT reasoning.
Outcome: Extensive experiments on two KGQA datasets show that the proposed model achieves convincing performance compared to strong baselines.
Correcting on Graph: Faithful Semantic Parsing over Knowledge Graphs with Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Complex multi-hop questions require comprehensive retrieval and reasoning.
Approach: They propose a semantic parsing framework to establish faithful logical queries that connect LLMs and knowledge graphs.
Outcome: The proposed framework outperforms state-of-the-art KGQA methods on knowledge-intensive questions.
KG-GPT: A General Framework for Reasoning on Knowledge Graphs Using Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Using large language models for complex reasoning tasks on knowledge graphs remains unexplored.
Approach: They propose a multi-purpose framework leveraging large language models for complex reasoning tasks on knowledge graphs.
Outcome: The proposed framework outperforms fully-supervised models in KG-based fact verification and KGQA benchmarks.
Digest the Knowledge: Large Language Models empowered Message Passing for Knowledge Graph Question Answering (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to augment large language models (LLMs) with external knowledge are unorganized and unorganized.
Approach: They propose a method that learns a concise facts graph and encodes it into multi-level lists of texts to augment LLMs.
Outcome: The proposed method improves on all 5 knowledge graph question answering datasets and offers human-level semantic explainability.
Thought-Action Graph Reasoning: Faithful and Efficient Reasoning of Large Language Models via Reusing Past Experience (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for integrating knowledge graphs with LLMs suffer from poor generalization or low reasoning efficiency.
Approach: They propose a thought-action Graph (TAG) that decomposes LLM-KG interaction trajectories into fine-grained semantic operators and guides LLM to execute on them.
Outcome: The proposed paradigm outperforms state-of-the-art methods on KGQA benchmarks while reducing the number of LLM calls and generated tokens.
Reasoning with Trees: Faithful Question Answering over Knowledge Graph (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have shown remarkable progress in reasoning capabilities, yet they still face challenges in complex, multi-step reasoning tasks.
Approach: They propose a framework that synergistically integrates LLMs with knowledge graphs (KGs) to enhance reasoning performance and interpretability.
Outcome: The proposed framework outperforms existing state-of-the-art methods on two benchmark KGQA datasets and improves on the MCTS process.
Generate-on-Graph: Treat LLM as both Agent and KG for Incomplete Knowledge Graph Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to integrate LLMs with Knowledge Graphs (KGs) however, these methods are often incomplete to cover all the knowledge required to answer questions.
Approach: They propose to integrate LLMs with Knowledge Graphs (KGs) to address insufficient knowledge and hallucination issues in Large Language Models.
Outcome: The proposed method outperforms existing methods on two datasets.
Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies suggest augmenting LLMs with external text corpora to alleviate hallucination problems.
Approach: They propose to augment large language models with text units retrieved from external knowledge corpora to alleviate the issue.
Outcome: The proposed framework outperforms baselines on GRBench with three LLMs and shows that iterative reasoning outperformed the baselines.
KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model’s Reasoning Path Aggregation (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for large language models (LLMs) are limited by step-by-step decision-making on KGs, or require fine-tuning or pre-training on specific KG.
Approach: They propose a framework that harnesses the global planning abilities of large language models (LLMs) for efficient and accurate KG reasoning.
Outcome: Extensive experiments show that the proposed framework achieves state-of-the-art performance in KGQA tasks, delivering both high efficiency and accuracy.
Self-supervised Quantized Representation for Seamlessly Integrating Knowledge Graphs with Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are gaining popularity due to their lack of knowledge hallucination and lack of a coherent model.
Approach: They propose a self-supervised quantized representation method to compress KG structural and semantic knowledge into discrete codes that align the format of language sentences.
Outcome: The proposed framework outperforms existing unsupervised methods producing more distinguishable codes on KG link prediction and triple classification tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations