Collaborative Policy Learning for Open Knowledge Graph Reasoning (D19-1)

Copied to clipboard

Challenge: Existing models of knowledge graph reasoning suffer from limited performance when working on sparse and incomplete graphs due to the lack of evidential paths that can reach target entities.
Approach: They propose a framework to train two collaborative agents to reason for missing facts over a graph augmented by a text corpus.
Outcome: Experiments on two public datasets show the proposed approach is effective on a knowledge graph reasoning task.

Similar Papers

Interactive Semantic Parsing with Reinforcement Learning for Knowledge Graph Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve LLM reliability rely on factual hallucinations . Existing methods rely only on graph traversal, resulting in imprecise retrieval and heavy post-processing burdens.
Approach: They propose a framework that integrates knowledge Graphs as structured, high-fidelity buffers to enhance LLM reliability.
Outcome: The proposed framework allows logical constraints to be dynamically interleaved with graph search while optimizing via reinforcement learning with only final answer feedback eliminates the need for gold program annotations.
Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answering (2021.findings-acl)

Copied to clipboard

Challenge: Existing approaches suffer from low confidence when retrieving evidence facts to fill the knowledge gap and lack transparent reasoning process.
Approach: They propose a framework to exploit more valid facts while obtaining explainability for multi-hop question answering at web scale by dynamically constructing a semantic graph and reasoning over it.
Outcome: The proposed framework surpasses existing approaches while maintaining high explainability on OpenBookQA and ARC-Challenge.
Multi-Hop Knowledge Graph Reasoning with Reward Shaping (D18-1)

Copied to clipboard

Challenge: Multi-hop reasoning is an effective approach for query answering over incomplete knowledge graphs (KGs).
Approach: They propose to adopt a pretrained one-hop embedding model to estimate reward of unobserved facts and to force agents to explore diverse set of paths using randomly generated edge masks.
Outcome: The proposed model reduces false negative supervision and counters spurious search trajectories by forcing the agent to explore a diverse set of paths using randomly generated edge masks.
Knowledge-guided Open Attribute Value Extraction with Reinforcement Learning (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for open attribute value extraction for emerging entities are noisy or incomplete, even missing.
Approach: They propose a knowledge-guided reinforcement learning framework for open attribute value extraction for emerging entities.
Outcome: The proposed framework outperforms baselines by 16.5 - 27.8%.
A Collaborative Reasoning Framework Powered by Reinforcement Learning and Large Language Models for Complex Questions Answering over Knowledge Graph (2025.coling-main)

Copied to clipboard

Challenge: Knowledge Graph Question Answering (KGQA) aims to answer natural language questions by reasoning across multiple triples in knowledge graphs.
Approach: They propose a collaborative reasoning framework powered by RL and LLMs to answer complex questions based on the knowledge graph.
Outcome: The proposed model surpasses state-of-the-art models on four datasets.
Knowledge Aware Conversation Generation with Explainable Reasoning over Augmented Graphs (D19-1)

Copied to clipboard

Challenge: Existing knowledge-based open domain conversation generation models are limited by the use of unstructured knowledge texts.
Approach: They propose a knowledge aware chatting machine with three components, an augmented knowledge graph with both triples and texts, knowledge selector, and knowledge aware response generator.
Outcome: The proposed system is more explainable and flexible than state-of-the-art models.
Rule-Aware Reinforcement Learning for Knowledge Graph Reasoning (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods to reason missing facts on Knowledge Graphs face with serious incompleteness due to their black-box nature.
Approach: They propose a multi-hop reasoning method that injects high quality symbolic rules into the model's reasoning process and employs partially random beam search.
Outcome: The proposed method outperforms existing multi-hop reasoning methods in terms of Hit@1 and MRR.
GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing graph RAGs decouple retrieval and reasoning processes, preventing adaptability . existing graph Raggings depend heavily on ground-truth entities, which are often unavailable in open-domain settings.
Approach: They propose a graph retriever that is trained end-to-end with large-scale graphs . structure and semantic features are encoded via soft tokens and the verbalized graph .
Outcome: The proposed approach improves the performance of large-scale graph retrieval models by grounding it with external knowledge.
Learning Contextualized Knowledge Structures for Commonsense Reasoning (2021.findings-acl)

Copied to clipboard

Challenge: Recent knowledge graph (KG) augmented models have achieved notable success on commonsense reasoning tasks.
Approach: They propose a KG-augmented model that contextualizes extracted and generated knowledge by reasoning over both within a single graph structure.
Outcome: The proposed model outperforms existing models on four commonsense reasoning benchmarks and a user study on edge validness and helpfulness.
Correcting on Graph: Faithful Semantic Parsing over Knowledge Graphs with Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Complex multi-hop questions require comprehensive retrieval and reasoning.
Approach: They propose a semantic parsing framework to establish faithful logical queries that connect LLMs and knowledge graphs.
Outcome: The proposed framework outperforms state-of-the-art KGQA methods on knowledge-intensive questions.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations