Challenge: Retrieval-augmented generation (RAG) is effective for question answering tasks . multi-hop questions, such as "Which company among NVIDIA, Apple, and Google made the biggest profit in 2023?" challenge RAG because relevant facts are often distributed across multiple documents .
Approach: They propose a pipeline that incorporates question decomposition to ground large language models in verifiable external sources.
Outcome: The proposed approach improves retrieval and answer accuracy over standard RAG . multi-hop questions often require multiple documents to support the model .

Similar Papers

Searching for Best Practices in Retrieval-Augmented Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, especially in specialized domains.
Approach: They propose several strategies for deploying RAG that balance performance and efficiency.
Outcome: The proposed approaches can significantly enhance question-answering capabilities and accelerate the generation of multimodal content using a “retrieval as generation” strategy.
Open-RAG: Enhanced Retrieval Augmented Reasoning with Open-Source Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to integrate Large Language Models with external knowledge suffer from limited reasoning capabilities, especially when using open-source LLMs.
Approach: They propose a framework that transforms an arbitrary dense LLM into a parameter-efficient sparse mixture of experts (MoE) model capable of handling complex reasoning tasks.
Outcome: The proposed framework transforms an arbitrary dense LLM into a parameter-efficient sparse mixture of experts (MoE) model capable of handling complex reasoning tasks, including both single- and multi-hop queries.
Query Decomposition for RAG: Balancing Exploration-Exploitation (2026.eacl-long)

Copied to clipboard

Challenge: Complex user queries often involve the exclusion of information, negation, or missing entities.
Approach: They propose to decompose user requests into subqueries, retrieve potentially relevant documents for each and then aggregate them to generate an answer.
Outcome: The proposed method achieves 35% gain in document-level precision and 15% increase in -nDCG . it also improves the downstream task of long-form generation.
MS-RAG: Simple and Effective Multi-Semantic Retrieval-Augmented Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for large language models suffer from poor indexing and inference speed . graph-based RAGs heavily rely on LLM for retrieval thus inference slow .
Approach: They propose retrieval-augmented generation (RAG) which integrates knowledge with dense vectors to build a multi-semantic RAG.
Outcome: The proposed method achieves state-of-the-art performance with faster inference speed compared to existing methods .
RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time.
Approach: They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge.
Outcome: The proposed approach improves performance on knowledge-intensive NLP tasks.
Retrieval-augmented Generation across Heterogeneous Knowledge (2022.naacl-srw)

Copied to clipboard

Challenge: Existing methods for retrieving knowledge from a single source homogeneous corpus have been gaining increasing attention in the field of natural language processing (NLP) however, they still suffer from the following drawbacks: (i) They are usually trained offline, making the model agnostic to the latest information, e.g., asking a chat-bot about COVID-19.
Approach: They propose to use a single-source homogeneous corpus to generate retrieval-augmented generation models that can learn from the pre-training corpus.
Outcome: The proposed methods have been applied to various knowledge-intensive NLP tasks, but most of the work has focused on retrieving unstructured text documents from Wikipedia.
A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences.
Approach: They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference .
Outcome: The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks.
Multilingual Retrieval-Augmented Generation for Knowledge-Intensive Question Answering Task (2026.findings-eacl)

Copied to clipboard

Challenge: Existing studies focus on English as the data language for RAG, resulting in limited coverage of multilingual RAG.
Approach: They propose a method that translates retrieved documents into a common language before generating the response.
Outcome: The proposed approach improves efficiency on knowledge-intensive tasks but introduces inconsistencies due to cross-lingual variations in the retrieved content.
SARA: Selective and Adaptive Retrieval-augmented Generation with Context Compression (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) extends large language models with external knowledge, but it must balance limited effective context, redundant retrieved evidence, and the loss of fine-grained facts.
Approach: They propose a hybrid RAG framework that uses natural-language snippets and semantic compression vectors to preserve passages in text form and compress remaining evidence into interpretable vectors for iterative evidence reranking.
Outcome: The proposed framework improves answer relevance, answer correctness and semantic similarity across 9 datasets and 5 open-source LLMs.
InfoGain-RAG: Boosting Retrieval-Augmented Generation through Document Information Gain-based Reranking and Filtering (2025.emnlp-main)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) frameworks struggle with identifying whether retrieved documents meaningfully contribute to answer generation.
Approach: They propose a document-related metric to quantify the contribution of retrieved documents to correct answer generation.
Outcome: The proposed framework outperforms existing approaches on both single and multiple retrieval paradigms.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations