Challenge: KBQA is a challenging area for pre-trained language models due to its extensive space and complexity.
Approach: They propose a model that uses multi-grained retrieval to focus on most relevant KB contexts . constrained decoding is used to control output space and reduce generation errors .
Outcome: The proposed model outperforms existing models on GrailQA and WebQuestionsSP.

Similar Papers

Rule-KBQA: Rule-Guided Reasoning for Complex Knowledge Base Question Answering with Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for knowledge base question answering lack grammaticality, faithfulness, and controllability due to hallucinations in the reasoning process.
Approach: They propose a framework that employs learned rules to guide the generation of logical forms.
Outcome: The proposed method achieves competitive results on standard KBQA datasets.
Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Knowledge base question answering (KBQA) is a challenging task, particularly in parsing intricate questions into executable logical forms.
Approach: They propose a framework to generate logical forms through direct interaction with knowledge bases (KBs) by annotating a dataset with step-wise reasoning processes.
Outcome: The proposed framework achieves competitive results on the WebQuestionsSP, ComplexWebQuestIONS, KQA Pro, and MetaQA datasets with a minimal number of examples (shots). Importantly, the proposed model supports manual intervention, allowing for the iterative refinement of LLM outputs.
No Need for Large-Scale Search: Exploring Large Language Models in Complex Knowledge Base Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: Knowledge Base Question Answering (KBQA) systems are a key research area in the field of natural language processing and information retrieval (IR).
Approach: They propose to use large language models to convert natural language questions to structured knowledge representations by using a three-step fine-tune strategy to implement the KBQA system.
Outcome: The proposed method achieves state-of-the-art performance across three datasets with a 79.9% F1 score.
GRV-KBQA: A Three-Stage Framework for Knowledge Base Question Answering with Decoupled Logical Structure, Semantic Grounding and Structure-Aware Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for Knowledge Base Question Answering generate non-executable queries and inefficiencies in query execution.
Approach: a framework that decouples logical structure generation from semantic grounding is proposed . the framework explicitly enforces KB constraints to improve alignment between generated logical forms and KB structures.
Outcome: GRV-KBQA decouples logical structure generation from semantic grounding and incorporates structure-aware validation to enhance accuracy.
ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing KBQA methods address inefficient knowledge retrieval and semantic parsing errors.
Approach: They propose a generatethen-retrieve KBQA framework that generates logical form and replaces entities and relations with an unsupervised retrieval method to improve both generation and retrieval more directly.
Outcome: Experimental results show that ChatKBQA achieves new state-of-the-art performance on standard KBQA datasets, WebQSP, and CWQ.
KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge Base (2022.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for Complex KBQA lack compositional reasoning capabilities . Existing methods for Complex questions are poor in diversity or scale .
Approach: They propose a compositional programming language to represent the reasoning process of complex questions.
Outcome: The proposed dataset includes around 120K diverse natural language questions . it provides a compositional and interpretable programming language to represent the reasoning process of complex questions based on the proposed model .
FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base Question Answering (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for question answering over knowledge bases (KBQA) suffer from generalization issues due to coarse-grained modeling of the logical expression.
Approach: They propose a fine-to- coarse-grained framework for KBQA to ensure generalization and executability of the logical expression.
Outcome: The proposed framework derives new state-of-the-art performance on GrailQA and WebQSP, and runs 4 times faster than baseline.
RGR-KBQA: Generating Logical Forms for Question Answering Using Knowledge-Graph-Enhanced Large Language Model (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for Knowledge Base Question Answering (KBQA) face hallucination problems, resulting in low accuracy.
Approach: They propose a retrieval-generate-retrieve framework that uses a Retrieve-Generate framework to retrieve factual knowledge from a knowledge graph.
Outcome: Experimental results show that RGR-KBQA improves on CWQ and WebQSP datasets.
Large-Scale Relation Learning for Question Answering over Knowledge Bases with Pre-trained Language Models (2021.emnlp-main)

Copied to clipboard

Challenge: Existing KBQA methods focus on the natural language but ignore textual information carried by the nodes and edges.
Approach: They propose to perform relation extraction, relation matching, and relation reasoning tasks to align the natural language expressions to the relations in the KB and reason over the missing connections.
Outcome: Experiments on WebQSP show that the proposed model outperforms baselines even when the KB is incomplete.
SymKGQA: Few-Shot Knowledge Graph Question Answering via Symbolic Program Generation and Execution (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in Large Language Models have led to low-level LFs that are limited to the knowledge of underlying LLM about the LF.
Approach: They propose a framework that generates a symbolic LF in a few-shot setting using Large Language Models.
Outcome: The proposed framework outperforms all other few-shot and many fully-supervised KGQA approaches.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations