Eliciting Critical Reasoning in Retrieval-Augmented Generation via Contrastive Explanations (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent studies show that LLMs struggle to critically analyse RAG-based in-context information. |
| Approach: | They propose a framework that elicits critical arguments in RAG via contrastive explanations . they propose CRAG to retrieve relevant documents given a query and generate explanations that explicitly contrast relevance of passages to support the final answer. |
| Outcome: | The proposed framework improves state-of-the-art RAG models while requiring significantly fewer prompts and demonstrations and robust to perturbations in the retrieved documents. |
Similar Papers
Improving Multilingual Retrieval-Augmented Language Models through Dialectic Reasoning Argumentations (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to ground large language models (LLMs) with RAGs are limited by the heterogeneity of knowledge retrieved. |
| Approach: | They propose a modular approach guided by Argumentative Explanations that evaluates retrieved information by comparing, contrasting and resolving conflicting perspectives. |
| Outcome: | The proposed framework significantly improves RAG approaches, requiring low-impact computational effort and providing robustness to knowledge perturbations. |
Enhancing Retrieval-Augmented Generation: A Study of Best Practices (2025.coling-main)
Copied to clipboard
| Challenge: | Retrieval-augmented generation systems have shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses. |
| Approach: | They propose to integrate query expansion, various novel retrieval strategies, and a Contrastive In-Context Learning RAG to improve response quality. |
| Outcome: | The proposed RAGs incorporate query expansion, various novel retrieval strategies, and a novel Contrastive In-Context Learning RAG. |
A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Yangning Li, Weizhi Zhang, Yuyao Yang, Wei-Chieh Huang, Yaozu Wu, Junyu Luo, Yuanchen Bei, Henry Peng Zou, Xiao Luo, Yusheng Zhao, Chunkit Chan, Yankai Chen, Zhongfen Deng, Yinghui Li, Hai-Tao Zheng, Dongyuan Li, Renhe Jiang, Ming Zhang, Yangqiu Song, Philip S. Yu
| Challenge: | a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences. |
| Approach: | They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference . |
| Outcome: | The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks. |
Searching for Best Practices in Retrieval-Augmented Generation (2024.emnlp-main)
Copied to clipboard
Xiaohua Wang, Zhenghua Wang, Xuan Gao, Feiran Zhang, Yixin Wu, Zhibo Xu, Tianyuan Shi, Zhengyuan Wang, Shizheng Li, Qi Qian, Ruicheng Yin, Changze Lv, Xiaoqing Zheng, Xuanjing Huang
| Challenge: | Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, especially in specialized domains. |
| Approach: | They propose several strategies for deploying RAG that balance performance and efficiency. |
| Outcome: | The proposed approaches can significantly enhance question-answering capabilities and accelerate the generation of multimodal content using a “retrieval as generation” strategy. |
Open-RAG: Enhanced Retrieval Augmented Reasoning with Open-Source Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to integrate Large Language Models with external knowledge suffer from limited reasoning capabilities, especially when using open-source LLMs. |
| Approach: | They propose a framework that transforms an arbitrary dense LLM into a parameter-efficient sparse mixture of experts (MoE) model capable of handling complex reasoning tasks. |
| Outcome: | The proposed framework transforms an arbitrary dense LLM into a parameter-efficient sparse mixture of experts (MoE) model capable of handling complex reasoning tasks, including both single- and multi-hop queries. |
Retrieval-augmented Generation across Heterogeneous Knowledge (2022.naacl-srw)
Copied to clipboard
| Challenge: | Existing methods for retrieving knowledge from a single source homogeneous corpus have been gaining increasing attention in the field of natural language processing (NLP) however, they still suffer from the following drawbacks: (i) They are usually trained offline, making the model agnostic to the latest information, e.g., asking a chat-bot about COVID-19. |
| Approach: | They propose to use a single-source homogeneous corpus to generate retrieval-augmented generation models that can learn from the pre-training corpus. |
| Outcome: | The proposed methods have been applied to various knowledge-intensive NLP tasks, but most of the work has focused on retrieving unstructured text documents from Wikipedia. |
Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs (2024.emnlp-main)
Copied to clipboard
Xin Zhou, Ping Nie, Yiwen Guo, Haojie Wei, Zhanqiu Zhang, Pasquale Minervini, Ruotian Ma, Tao Gui, Qi Zhang, Xuanjing Huang
| Challenge: | Existing research seeks to enhance RAG performance by retrieving higher-quality documents or designing RAG-specific LLMs, but internal mechanisms that contribute to RAG’s effectiveness remain underexplored. |
| Approach: | They propose to examine the internal mechanisms within the popular Mixture-of-Expert (MoE)-based LLMs and examine their ability to improve RAG by examining expert activations. |
| Outcome: | The proposed method significantly improved the ability of Large Language Models (LLMs) to solve knowledge-intensive tasks. |
On the Influence of Context Size and Model Choice in Retrieval-Augmented Generation Systems (2025.findings-naacl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is an approach to augment large language models (LLMs) despite their impressive performance, LLMs can generate plausible sounding but factually incorrect responses (hallucinations) |
| Approach: | They propose to use BM25 and semantic search as retrievers to augment large language models by reducing their reliance on static knowledge and improving answer factuality. |
| Outcome: | The proposed approach improves QA performance on a biomedical task with up to 15 snippets but stagnates or declines beyond that. |
Probing-RAG: Self-Probing to Guide Language Models in Selective Document Retrieval (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to optimize retrieve-and-generate processes for real-world scenarios may not be optimal for large language models. |
| Approach: | They propose a Probing-RAG which utilizes hidden state representations from the intermediate layers of language models to adaptively determine the necessity of additional retrievals for a given query. |
| Outcome: | The proposed method outperforms previous methods while reducing the number of redundant retrieval steps. |
RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation (2024.emnlp-demo)
Copied to clipboard
Xuanwang Zhang, Yun-Ze Song, Yidong Wang, Shuyun Tang, Xinfeng Li, Zhengran Zeng, Zhen Wu, Wei Ye, Wenyuan Xu, Yue Zhang, Xinyu Dai, Shikun Zhang, Qingsong Wen
| Challenge: | Existing research on Retrieval Augmented Generation (RAG) does not address the problem of hallucinations and real-time updating of knowledge. |
| Approach: | They propose a modular open-source library to equip LLMs with external knowledge. |
| Outcome: | The proposed approach reduces the need for expensive open-source tools and lacks fair comparisons between novel RAG algorithms. |