Challenge: Existing methods for visual information-seeking tasks rely on textual knowledge . existing methods can impair information retrieval and confuse MLLMs .
Approach: They propose a framework which leverages a multimodal knowledge base to address these limitations.
Outcome: The proposed framework outperforms state-of-the-art methods on the InfoSeek and E-VQA benchmarks.

Similar Papers

MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text (2022.emnlp-main)

Copied to clipboard

Challenge: Pre-trained language models store a massive amount of world knowledge implicitly in their parameters, but large models often fail to encode information about rare entities and events.
Approach: They propose a retrieval-augmented model which accesses an external non-parametric memory to augment language generation.
Outcome: The proposed model outperforms existing models by 10-20% absolute on two datasets and under distractor and full-wiki settings.
MegaRAG: Multimodal Knowledge Graph-Based Retrieval Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing RAG solutions for large language models are limited by context windows limiting their ability to process long-form, domain-specific content.
Approach: They propose a multimodal knowledge graph-based RAG that enables cross-modal reasoning . their method incorporates visual cues into the construction of knowledge graphs, retrieval phase, and answer generation process .
Outcome: Experimental results show that the proposed approach outperforms existing approaches on textual and multimodal benchmarks.
EchoSight: Advancing Visual-Language Models with Wiki Knowledge (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge-based visual question answering systems struggle with these tasks due to limited integration of external knowledge.
Approach: They propose a framework that enables large language models to answer visual questions requiring encyclopedic knowledge.
Outcome: The proposed framework improves retrieval outcomes and accuracy of knowledge-based visual question answering tasks.
Retrieving Multimodal Information for Augmented Generation: A Survey (2023.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly using multimodality to augment their generation ability, but there is no unified perception of at which stage and how to incorporate different modalities.
Approach: They propose to use multimodality to augment Large Language Models (LLMs) this will provide scholars with a deeper understanding of the methods' applications and encourage them to adapt existing techniques to the fast-growing field of LLMs.
Outcome: The proposed methods improve factuality, reasoning, interpretability, and robustness of the generated content.
Seeing Beyond: Enhancing Visual Question Answering with Multi-Modal Retrieval (2025.coling-industry)

Copied to clipboard

Challenge: Multi-modal Large language models still suffer from model hallucination and lack of specific knowledge when answering challenging questions.
Approach: They propose to use a multi-modal retrieval augmented generation method to integrate knowledge from all modalities into a model to enable alignment between query and knowledge.
Outcome: The proposed method achieves significant performance improvement on the VQA dataset.
Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Document understanding is critical for applications from financial analysis to scientific discovery.
Approach: They propose a taxonomy based on domain, retrieval modality, and granularity and review advances involving graph structures and agentic frameworks.
Outcome: The proposed model enables holistic retrieval and reasoning across all modalities, unlocking comprehensive document intelligence.
Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data.
Approach: They review training strategies, robustness enhancements, loss functions, and agent-based approaches and outline open challenges and future directions to guide research in this evolving field.
Outcome: The proposed model improves accuracy and accuracy while integrating external dynamic information for improved factual grounding.
Progressive Multimodal Search and Reasoning for Knowledge-Intensive Visual Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to knowledge-intensive visual question answering lack mechanisms to revise misdirected reasoning.
Approach: They propose a framework that progressively constructs a structured reasoning trajectory . they use dual-scope queries to retrieve diverse knowledge from heterogeneous knowledge bases .
Outcome: The proposed framework improves retrieval recall and end-to-end answer accuracy.
Multi-Level Information Retrieval Augmented Generation for Knowledge-based Visual Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: Knowledge-Aware Visual Question Answering about Entity tasks require two separate steps to generate accurate answers.
Approach: They propose a multi-level information RAG approach that enhances answer generation through entity retrieval and query expansion.
Outcome: The proposed approach improves answer generation through entity retrieval and query expansion.
OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for Knowledge-Based Visual Question Answering lack multimodal retrieval . large language models (LLMs) have demonstrated remarkable generalization and reasoning capabilities in text-based systems.
Approach: They propose a multimodal vision-language retrieval-augmented generation system that harmonizes multiple modalities and modality to enhance retrieval.
Outcome: The proposed system achieves state-of-the-art retrieval performance and competitive answers on InfoSeek and Encyclopedic-VQA benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations