Challenge: Existing approaches struggle with mapping questions to precise logical forms . Existing frameworks struggle with complex mapping of questions to logical form .
Approach: They propose a framework that leverages a hierarchical multi-task learning paradigm to enhance the performance of logical form generation.
Outcome: The proposed framework outperforms supervised fine-tuning methods and training-free ones on large language models.

Similar Papers

Logical Form Generation via Multi-task Learning for Complex Question Answering over Knowledge Bases (2022.coling-1)

Copied to clipboard

Challenge: Existing generation-based KBQA methods that translate natural language questions to executable logical forms are proving promising but noise introduced can lead to incorrect results.
Approach: They propose a Generation-based KBQA method that uses auxiliary information to enhance logical form generation by combining unseen KB items with novel combinations.
Outcome: The proposed method achieves state-of-the-art results on ComplexWebQuestions and WebQuestIONSSP datasets.
Beyond Seen Data: Improving KBQA Generalization Through Schema-Guided Logical Form Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Knowledge base question answering (KBQA) aims to answer user questions in natural language using rich human knowledge stored in large KBs.
Approach: They propose a model that injects schema contexts into entity retrieval and logical form generation to enhance generalizability.
Outcome: The proposed model outperforms state-of-the-art models on two commonly used benchmark datasets across a variety of test settings.
CompKBQA: Component-wise Task Decomposition for Knowledge Base Question Answering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge base question answering methods struggle with complex queries.
Approach: They propose a framework that optimizes the process of fine-tuning a LLM for generating logical forms by enabling it to learn relevant sub-tasks like skeleton generation, topic entity generation, and relevant relations generation.
Outcome: The proposed framework achieves state-of-the-art on two benchmark KBQA datasets, WebQSP and CWQ.
Large-Scale Relation Learning for Question Answering over Knowledge Bases with Pre-trained Language Models (2021.emnlp-main)

Copied to clipboard

Challenge: Existing KBQA methods focus on the natural language but ignore textual information carried by the nodes and edges.
Approach: They propose to perform relation extraction, relation matching, and relation reasoning tasks to align the natural language expressions to the relations in the KB and reason over the missing connections.
Outcome: Experiments on WebQSP show that the proposed model outperforms baselines even when the KB is incomplete.
RGR-KBQA: Generating Logical Forms for Question Answering Using Knowledge-Graph-Enhanced Large Language Model (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for Knowledge Base Question Answering (KBQA) face hallucination problems, resulting in low accuracy.
Approach: They propose a retrieval-generate-retrieve framework that uses a Retrieve-Generate framework to retrieve factual knowledge from a knowledge graph.
Outcome: Experimental results show that RGR-KBQA improves on CWQ and WebQSP datasets.
GRV-KBQA: A Three-Stage Framework for Knowledge Base Question Answering with Decoupled Logical Structure, Semantic Grounding and Structure-Aware Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for Knowledge Base Question Answering generate non-executable queries and inefficiencies in query execution.
Approach: a framework that decouples logical structure generation from semantic grounding is proposed . the framework explicitly enforces KB constraints to improve alignment between generated logical forms and KB structures.
Outcome: GRV-KBQA decouples logical structure generation from semantic grounding and incorporates structure-aware validation to enhance accuracy.
Rule-KBQA: Rule-Guided Reasoning for Complex Knowledge Base Question Answering with Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for knowledge base question answering lack grammaticality, faithfulness, and controllability due to hallucinations in the reasoning process.
Approach: They propose a framework that employs learned rules to guide the generation of logical forms.
Outcome: The proposed method achieves competitive results on standard KBQA datasets.
Multi-Task Learning for Conversational Question Answering over a Large-Scale Knowledge Base (D19-1)

Copied to clipboard

Challenge: Recent approaches to handle large knowledge base decompose tasks into subtasks and solve them sequentially.
Approach: They propose a multi-task learning framework that resolves coreference in conversations . they propose enabling shared supervisions and type-aware entity detection model .
Outcome: The proposed framework improves overall F1 score from 67% to 79% on a large-scale conversational question answering dataset.
Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Knowledge base question answering (KBQA) is a challenging task, particularly in parsing intricate questions into executable logical forms.
Approach: They propose a framework to generate logical forms through direct interaction with knowledge bases (KBs) by annotating a dataset with step-wise reasoning processes.
Outcome: The proposed framework achieves competitive results on the WebQuestionsSP, ComplexWebQuestIONS, KQA Pro, and MetaQA datasets with a minimal number of examples (shots). Importantly, the proposed model supports manual intervention, allowing for the iterative refinement of LLM outputs.
ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing KBQA methods address inefficient knowledge retrieval and semantic parsing errors.
Approach: They propose a generatethen-retrieve KBQA framework that generates logical form and replaces entities and relations with an unsupervised retrieval method to improve both generation and retrieval more directly.
Outcome: Experimental results show that ChatKBQA achieves new state-of-the-art performance on standard KBQA datasets, WebQSP, and CWQ.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations