Challenge: RICHES interleaves retrieval with sequence generation tasks . traditional approaches chain LLM generation with separate retrieval model .
Approach: They propose a novel approach that interleaves retrieval with sequence generation tasks . they propose attributed evidence, multi-hop retrievals and interleave thoughts to plan on what to retrieve next .
Outcome: The proposed approach can work with any Instruction-tuned model, without additional training.

Similar Papers

RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time.
Approach: They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge.
Outcome: The proposed approach improves performance on knowledge-intensive NLP tasks.
Retrieval-augmented Generation across Heterogeneous Knowledge (2022.naacl-srw)

Copied to clipboard

Challenge: Existing methods for retrieving knowledge from a single source homogeneous corpus have been gaining increasing attention in the field of natural language processing (NLP) however, they still suffer from the following drawbacks: (i) They are usually trained offline, making the model agnostic to the latest information, e.g., asking a chat-bot about COVID-19.
Approach: They propose to use a single-source homogeneous corpus to generate retrieval-augmented generation models that can learn from the pre-training corpus.
Outcome: The proposed methods have been applied to various knowledge-intensive NLP tasks, but most of the work has focused on retrieving unstructured text documents from Wikipedia.
Ground Every Sentence: Improving Retrieval-Augmented LLMs with Interleaved Reference-Claim Generation (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods to enhance credibility and verifiability of large language models (LLMs) mainly focus on passage-level or paragraph-level references or citations, which fall short in verifikatability.
Approach: They propose a method that provides sentence-level citations in LLM-generated responses.
Outcome: The proposed method achieves 90% accuracy in long-form question-answering tasks.
Question Decomposition for Retrieval-Augmented Generation (2025.acl-srw)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is effective for question answering tasks . multi-hop questions, such as "Which company among NVIDIA, Apple, and Google made the biggest profit in 2023?" challenge RAG because relevant facts are often distributed across multiple documents .
Approach: They propose a pipeline that incorporates question decomposition to ground large language models in verifiable external sources.
Outcome: The proposed approach improves retrieval and answer accuracy over standard RAG . multi-hop questions often require multiple documents to support the model .
Enhancing Retrieval-Augmented Generation: A Study of Best Practices (2025.coling-main)

Copied to clipboard

Challenge: Retrieval-augmented generation systems have shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.
Approach: They propose to integrate query expansion, various novel retrieval strategies, and a Contrastive In-Context Learning RAG to improve response quality.
Outcome: The proposed RAGs incorporate query expansion, various novel retrieval strategies, and a novel Contrastive In-Context Learning RAG.
Retrieval as Generation: A Unified Framework with Self-Triggered Information Planning (2026.acl-long)

Copied to clipboard

Challenge: Existing models that ground retrieval on external evidence are limited in their ability to implement retrieval-augmented generation.
Approach: They propose a retrieval-augmented generation model that embeds retrieval control directly into generation.
Outcome: The proposed model surpasses strong RAG baselines and uses substantially fewer parameters.
RetroLLM: Empowering Large Language Models to Retrieve Fine-grained Evidence within Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing methods rely on separate retrievers to fetch top-k text chunks for generating evidence, and they lack joint optimization.
Approach: They propose a framework that integrates retrieval and generation into a single, auto-regressive process, enabling LLMs to directly generate fine-grained evidence from the corpus with constrained decoding.
Outcome: Extensive experiments on five open-domain QA datasets demonstrate the proposed framework’s superior performance across both in-domain and out-of-domain tasks.
DiffusionRet: Diffusion-Enhanced Generative Retriever using Constrained Decoding (2023.findings-emnlp)

Copied to clipboard

Challenge: Generative retrieval methods have suffered from the lack of the intermediate reasoning step . generative retrieval uses sequence-to-sequence diffusion models to map a query to relevant docids .
Approach: They propose a novel method that uses query as an intermediate step before retrieval . they propose to use sequence-to-sequence diffusion models to map a query to relevant docids .
Outcome: Experiments show that proposed method outperforms existing methods on MARCO and Natural Questions datasets.
RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructions (2025.emnlp-main)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) has emerged as a key paradigm for enhancing large language models by incorporating external knowledge.
Approach: They propose a method for synthesizing diverse and high-quality RAG instruction data based on any source corpus.
Outcome: The proposed method outperforms existing methods in multiple tasks and achieves strong zero-shot performance.
Accelerating Adaptive Retrieval Augmented Generation via Instruction-Driven Representation Reduction of Retrieval Overlaps (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to augmented generation ignore the overlap in retrieval results . overlapping content is redundantly represented, affecting the overall efficiency.
Approach: They propose a model-agnostic approach to re-augmented generation that speeds up prefilling and decoding . they propose an instruction-driven module to guide the model to more suitable ways for LLMs .
Outcome: The proposed approach achieves 2.79 and 2.33 times significant acceleration on average for prefilling and decoding respectively while maintaining equal generation quality.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations