Challenge: Existing methods for multihop Knowledge Graph Question Answering (KGQA) treat each reasoning step independently and fail to leverage experience from prior explorations, leading to fragmented reasoning and redundant exploration.
Approach: They propose a framework that unifies LLM-driven contextual reasoning with exploration prior integration to enhance coherence and robustness of multihop KGQA.
Outcome: Extensive experiments on multiple KGQA benchmarks show that TRACE outperforms state-of-the-art methods.

Similar Papers

Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering (2020.emnlp-main)

Copied to clipboard

Challenge: Existing work on augmenting question answering models with external knowledge (e.g., knowledge graphs) lacks transparency into the model’s prediction rationale.
Approach: They propose a knowledge-aware approach that equips pre-trained language models with a multi-hop relational reasoning module that performs multi-relational reasoning over subgraphs extracted from external knowledge graphs.
Outcome: The proposed model performs multi-hop, multi-relational reasoning over subgraphs extracted from external knowledge graphs.
Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods rely on linear sequential operations to solve First-Order Logic queries.
Approach: They propose a model-agnostic approach that fully integrates the context of the query graph.
Outcome: The proposed method improves performance on two datasets by 19.5%.
TRACE: Traversal Retrieval-Augmented Chain of Evidence for Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Long-context Document Visual Question Answering (DocVQA) methods struggle with visual semantics or handling finite context windows.
Approach: They propose a new approach to longcontext document visual question answering that transforms retrieval into adaptive evidence chain construction using a Bi-Layered Graph.
Outcome: The proposed approach achieves an average accuracy improvement of 14.07% on M5BookVQA and exhibits robust generalization with a 13.38% gain across four established benchmarks.
Exploiting Hybrid Semantics of Relation Paths for Multi-hop Question Answering over Knowledge Graphs (2022.coling-1)

Copied to clipboard

Challenge: Existing approaches to answer natural language questions on knowledge graphs (KGQA) use large-scale entity-related text corpus or knowledge graph embeddings as auxiliary information to facilitate answer selection.
Approach: They propose to integrate explicit textual information and implicit KG structural features of relation paths into a novel rotate-and-scale entity link prediction framework.
Outcome: The proposed method is superior to existing methods on three KGQA datasets and shows that it can be used to identify answer entities.
NovelHopQA: Diagnosing Multi-Hop Reasoning Failures in Long Narrative Contexts (2025.emnlp-main)

Copied to clipboard

Challenge: Current large language models struggle to answer questions that span tens of thousands of tokens.
Approach: They evaluate 1–4 hop QA over 64k–128k-token excerpts from 83 novels . they find consistent accuracy drops with increased hops and context length .
Outcome: The novelhopqa benchmark evaluates 1–4 hop QA over 64k–128k-token excerpts from 83 public-domain novels.
Beyond the Answer: Advancing Multi-Hop QA with Fine-Grained Graph Reasoning and Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing evaluations of multi-hop question answering systems focus on comparing final answers of reasoning method and given ground-truths.
Approach: They propose a "Planner-Executor-Reasoner" architecture that evaluates reasoning . they propose PER-DP and PER QA architectures that provide ground-truths .
Outcome: The proposed model improves the performance of multi-hop question answering systems.
StepKE: Stepwise Knowledge Editing for Multi-Hop Question Answering (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge editing methods overlook interplay with pre-existing knowledge, leading to inconsistent edit propagation.
Approach: stepKE integrates edited and existing knowledge for coherent multi-hop reasoning . stepKE decomposes multi-step questions into sequential single-hop sub-questions .
Outcome: Experiments show that StepKE generates more accurate and consistent responses than baselines.
STEM: Structure-Tracing Evidence Mining for Knowledge Graphs-Driven Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing reasoning path retrieval methods lack a global structural perspective.
Approach: They propose a framework that reframes multi-hop reasoning as a schema-guided graph search task.
Outcome: The proposed framework improves accuracy and evidence completeness of multi-hop reasoning graph retrieval.
Thought-Action Graph Reasoning: Faithful and Efficient Reasoning of Large Language Models via Reusing Past Experience (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for integrating knowledge graphs with LLMs suffer from poor generalization or low reasoning efficiency.
Approach: They propose a thought-action Graph (TAG) that decomposes LLM-KG interaction trajectories into fine-grained semantic operators and guides LLM to execute on them.
Outcome: The proposed paradigm outperforms state-of-the-art methods on KGQA benchmarks while reducing the number of LLM calls and generated tokens.
Commonsense for Generative Multi-Hop Question Answering Tasks (D18-1)

Copied to clipboard

Challenge: Reading comprehension QA tasks have seen a recent surge in popularity, yet most work has focused on fact-finding extractive QA.
Approach: They propose a multi-hop generative task that uses a pointer-generator decoder to synthesize disjoint pieces of information within the context to generate an answer.
Outcome: The proposed model performs better than previous generative models and is competitive with current state-of-the-art span prediction models.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations