Challenge: Existing multimodal question answering models rely on sequential retrieval and reasoning, but this single-path paradigm makes them vulnerable to errors due to misleading intermediate steps.
Approach: They propose a multimodal multi-hop question answering framework guided by an Adaptive Planning Graph . they propose modality-specific strategies that dynamically adapt to distinct data types .
Outcome: The proposed framework outperforms existing models that rely on training.

Similar Papers

Progressive Planning and Reinforced Reasoning: Large Language Model-Guided Multi-hop Question Answering over Knowledge Graph (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to multi-hop question answering lack effective intermediate guidance and policy networks focus on local neighborhood information, making it difficult to anticipate the long-term consequences of decisions.
Approach: They propose a framework that converts decomposed sub-question sequences into stepwise decision guidance and a structure-aware lookahead policy network to enhance the agent's global state awareness and decision foresight in complex environments.
Outcome: The proposed framework surpasses state-of-the-art methods while showing strong generalization.
Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods rely on linear sequential operations to solve First-Order Logic queries.
Approach: They propose a model-agnostic approach that fully integrates the context of the query graph.
Outcome: The proposed method improves performance on two datasets by 19.5%.
Learning to Ask: Multi-Decoder Fine-Tuning for Multi-Hop Visual Question Generation with External Knowledge (2026.findings-eacl)

Copied to clipboard

Challenge: Traditional supervised QG methods rely on tokenlevel alignment with fixed gold labels struggle to capture diverse valid question formulations.
Approach: They propose a model-agnostic framework that integrates multimodal inputs with a multi-decoder architecture to optimize for multiple labels per sample.
Outcome: The proposed framework improves fluency, reasoning depth, and relevance of visual questions.
Query-Driven Multimodal GraphRAG: Dynamic Local Knowledge Graph Construction for Online Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to build knowledge graphs with LLMs are constrained by static knowledge bases and ineffective multimodal data integration.
Approach: They propose a Query-Driven Multimodal GraphRAG framework that dynamically constructs local knowledge graphs tailored to query semantics.
Outcome: The proposed framework outperforms unsupervised competitors in cross-modal understanding of complex queries.
Resource-Friendly Dynamic Enhancement Chain for Multi-Hop Question Answering (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to solve multi-hop question answering challenges require multiple rounds of retrieval and iterative generation.
Approach: They propose a framework that decomposes complex questions into coherent subquestions . it then iteratively refines these subquests through context-aware rewriting to generate effective query formulations.
Outcome: The proposed framework performs on par with or surpasses state-of-the-art benchmarks while significantly reducing token consumption.
MIRe: Enhancing Multimodal Queries Representation via Fusion-Free Modality Interaction for Multimodal Retrieval (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on textual queries that include visual information, but lack the ability to address multimodal queries that encompass both textual and visual information.
Approach: They propose a retrieval framework that achieves modality interaction without fusing textual features during the alignment.
Outcome: The proposed method achieves modality interaction without fusing textual features during the alignment.
Following Occam’s Razor: Dynamic Combination of Structured Knowledge for Multi-Hop Question Answering using LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Multi-hop question answering is a challenging task that requires capturing information from multiple positions in multiple documents.
Approach: They propose a framework for integrating text-based and triple-based paradigms that incorporates structured knowledge into large-scale question answering.
Outcome: The proposed framework improves multi-hop question answering by incorporating structured knowledge into the models.
Unsupervised Multi-hop Question Answering by Question Generation (2021.naacl-main)

Copied to clipboard

Challenge: Existing training data for multi-hop question answering (QA) is time-consuming and resource-intensive.
Approach: They propose an unsupervised framework that generates human-like multi-hop training data from homogeneous and heterogeneously data sources.
Outcome: The proposed framework achieves 61% and 83% of the supervised learning performance for the HybridQA and HotpotQA datasets.
Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering (2022.coling-1)

Copied to clipboard

Challenge: Generative question answering (QA) models generate answers to complex questions, but their mechanism for doing so is still poorly understood.
Approach: They decompose multi-hop questions into multiple corresponding single-hop question chains and find marked inconsistency in QA models’ answers on these pairs of ostensibly identical question chains.
Outcome: The proposed models lack zero-shot multi-hop reasoning ability when trained on single-hop questions and on logical forms.
Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for multi-hop reasoning ignore grounding on supporting facts of each step, which tends to generate inaccurate decompositions.
Approach: They propose an interpretable stepwise reasoning framework that incorporates supporting sentences and questions at each intermediate step and utilizes the inference of the current hop for the next until reasoning out the final result.
Outcome: The proposed model can boost performance and yield a better interpretable reasoning process without decomposition supervision.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations