Challenge: Existing knowledge base question answering methods generate LFs that are non-executable due to semantic hallucination issue of large language models.
Approach: They propose a "generate-verify-refine" framework for reliable LF generation . they propose ARI-KBQA to generate query paths based on hop-by-hop reasoning .
Outcome: The proposed framework significantly improves model performance with a reduced search space . ARI-KBQA can generate LFs that are non-executable due to semantic hallucination issue .

Similar Papers

RGR-KBQA: Generating Logical Forms for Question Answering Using Knowledge-Graph-Enhanced Large Language Model (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for Knowledge Base Question Answering (KBQA) face hallucination problems, resulting in low accuracy.
Approach: They propose a retrieval-generate-retrieve framework that uses a Retrieve-Generate framework to retrieve factual knowledge from a knowledge graph.
Outcome: Experimental results show that RGR-KBQA improves on CWQ and WebQSP datasets.
ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing KBQA methods address inefficient knowledge retrieval and semantic parsing errors.
Approach: They propose a generatethen-retrieve KBQA framework that generates logical form and replaces entities and relations with an unsupervised retrieval method to improve both generation and retrieval more directly.
Outcome: Experimental results show that ChatKBQA achieves new state-of-the-art performance on standard KBQA datasets, WebQSP, and CWQ.
Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Knowledge base question answering (KBQA) is a challenging task, particularly in parsing intricate questions into executable logical forms.
Approach: They propose a framework to generate logical forms through direct interaction with knowledge bases (KBs) by annotating a dataset with step-wise reasoning processes.
Outcome: The proposed framework achieves competitive results on the WebQuestionsSP, ComplexWebQuestIONS, KQA Pro, and MetaQA datasets with a minimal number of examples (shots). Importantly, the proposed model supports manual intervention, allowing for the iterative refinement of LLM outputs.
GRV-KBQA: A Three-Stage Framework for Knowledge Base Question Answering with Decoupled Logical Structure, Semantic Grounding and Structure-Aware Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for Knowledge Base Question Answering generate non-executable queries and inefficiencies in query execution.
Approach: a framework that decouples logical structure generation from semantic grounding is proposed . the framework explicitly enforces KB constraints to improve alignment between generated logical forms and KB structures.
Outcome: GRV-KBQA decouples logical structure generation from semantic grounding and incorporates structure-aware validation to enhance accuracy.
KaeDe: Progressive Generation of Logical Forms via Knowledge-Aware Question Decomposition for Improved KBQA (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for answering natural language questions are difficult to generate . lack of a logical form for complex graphs can negatively impact overall performance .
Approach: They propose a generate-then-retrieve method that converts questions into structured LF queries . they propose to combine knowledge-aware question decomposition and progressive LF generation .
Outcome: The proposed method achieves state-of-the-art (SOTA) performance on WebQuestionSP and ComplexWebQuestions benchmarks.
Rule-KBQA: Rule-Guided Reasoning for Complex Knowledge Base Question Answering with Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for knowledge base question answering lack grammaticality, faithfulness, and controllability due to hallucinations in the reasoning process.
Approach: They propose a framework that employs learned rules to guide the generation of logical forms.
Outcome: The proposed method achieves competitive results on standard KBQA datasets.
From Parse-Execute to Parse-Execute-Refine: Improving Semantic Parser for Complex Question Answering over Knowledge Base (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for parsing knowledge-base questions into executable logical forms have not been successful on complex KBQA.
Approach: They propose a new semantic parser called KoPL to model the reasoning processes . they propose 'parse-execute-refine' paradigm to unlock reasoning ability .
Outcome: The proposed parser performs better than the state-of-the-art on complex KBQA . the proposed parsed-execute-refine paradigm can model complex reasoning steps .
CompKBQA: Component-wise Task Decomposition for Knowledge Base Question Answering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge base question answering methods struggle with complex queries.
Approach: They propose a framework that optimizes the process of fine-tuning a LLM for generating logical forms by enabling it to learn relevant sub-tasks like skeleton generation, topic entity generation, and relevant relations generation.
Outcome: The proposed framework achieves state-of-the-art on two benchmark KBQA datasets, WebQSP and CWQ.
Execution as Verification: Fine-Grained Self-Correcting Reasoning for Complex KBQA (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge base question answering methods are limited by syntactic constraints and are prone to structural deviations that render queries unexecutable.
Approach: They propose a framework that reframes semantic parsing as an iterative reasoning process driven by execution feedback.
Outcome: The proposed method achieves significant improvements in query executability and answer accuracy on the WebQSP and CWQ datasets.
Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Knowledge base question answering (KBQA) aims to answer user questions in natural language using rich human knowledge stored in large KBs.
Approach: They propose a model that injects schema contexts into entity retrieval and logical form generation to enhance generalizability.
Outcome: The proposed model outperforms state-of-the-art models on two commonly used benchmark datasets across a variety of test settings.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations