Challenge: Large Language Models (LLMs) excel at natural language understanding and generation, yet rely on static pre-training data.
Approach: They propose to augment Large Language Models with external retrieval to ground model outputs . traditional RAG is constrained by a fixed retrieve-then-generate routine . authors aim to guide creation of high-quality datasets for next generation of adaptive LLM agents .
Outcome: The proposed model can decompose tasks, issue exploratory queries, and refine evidence through iterative retrieval.

Similar Papers

A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences.
Approach: They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference .
Outcome: The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks.
Is Agentic RAG worth it? An experimental comparison of RAG approaches (2026.acl-industry)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) systems have several limitations, including noisy or suboptimal retrieval, misuse of retrieval for out-of-scope queries, weak query–document matching, and variability or cost associated with the generator.
Approach: They propose to use a "Enhanced" RAG to address weaknesses in the workflow . they propose to orchestrate the entire process, deciding which actions to perform, when to perform them, and whether to iterate .
Outcome: The proposed models address shortcomings in the RAG workflow, and provide practical insights into the trade-offs between them.
RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time.
Approach: They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge.
Outcome: The proposed approach improves performance on knowledge-intensive NLP tasks.
Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data.
Approach: They review training strategies, robustness enhancements, loss functions, and agent-based approaches and outline open challenges and future directions to guide research in this evolving field.
Outcome: The proposed model improves accuracy and accuracy while integrating external dynamic information for improved factual grounding.
M-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitions (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for retrieving relevant memories from an external database are coarse-grained and can cause noise and focus on crucial memories.
Approach: They propose a multiple partition paradigm for RAG where each database partition serves as a basic unit for execution.
Outcome: The proposed framework outperforms baseline methods on three language generation tasks on seven datasets.
RAG-Studio: Towards In-Domain Adaptation of Retrieval Augmented Generation Through Self-Alignment (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing RAG systems that use pre-trained LLMs and retrievers often fail in specialized domains and applications.
Approach: They propose a self-aligned training framework that adapts general RAG models to specific domains solely through synthetic data.
Outcome: Experiments on specialized domain corpus, general LLM, and general retriever show that the self-aligned training framework outperforms human-annotated training data in specialized fields.
Enhancing Retrieval-Augmented Generation: A Study of Best Practices (2025.coling-main)

Copied to clipboard

Challenge: Retrieval-augmented generation systems have shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.
Approach: They propose to integrate query expansion, various novel retrieval strategies, and a Contrastive In-Context Learning RAG to improve response quality.
Outcome: The proposed RAGs incorporate query expansion, various novel retrieval strategies, and a novel Contrastive In-Context Learning RAG.
Scaling Beyond Context: A Survey of Multimodal Retrieval-Augmented Generation for Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Document understanding is critical for applications from financial analysis to scientific discovery.
Approach: They propose a taxonomy based on domain, retrieval modality, and granularity and review advances involving graph structures and agentic frameworks.
Outcome: The proposed model enables holistic retrieval and reasoning across all modalities, unlocking comprehensive document intelligence.
Separate the Wheat from the Chaff: Winnowing Down Divergent Views in Retrieval Augmented Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) lack robustness in knowledge-intensive tasks due to noisy or irrelevant retrieved data.
Approach: They propose a multi-agent debate-based RAG framework that integrates external knowledge sources into large language models to improve their accuracy.
Outcome: The proposed framework is unsupervised and leverages pretrained LLMs without fine-tuning, making it easily adaptable to various tasks.
MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing RAG systems struggle with the quality of retrieval documents, causing performance degradation and reducing performance.
Approach: They propose a training-free RAG framework that leverages multiple LLM agents to collaboratively filter and score retrieved documents.
Outcome: The proposed framework outperforms existing RAG frameworks in QA benchmarks and shows superior answer consistency and answer accuracy over baseline methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations