The Distracting Effect: Understanding Irrelevant Passages in RAG (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to detect and use hard distracting passages in RAG can cause problems . retrieved passages contain irrelevant but semantically related information that may mislead the LLM . |
| Approach: | They propose a method to identify and use hard distracting passages to improve RAG . they find that adding retrieved passages is found to ground the LLM response . |
| Outcome: | The proposed method achieves up to 7.5% increase in answering accuracy compared to fine-tuned datasets. |
Similar Papers
Do RAG Systems Really Suffer From Positional Bias? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Retrieval Augmented Generation (RAG) improves the factual accuracy of LLMs on knowledgeintensive tasks by including in the prompt passages retrieved from an external corpus. |
| Approach: | They propose to use a retrieval algorithm to add passages from an external corpus to the LLM prompt to improve the factual accuracy of LLMs. |
| Outcome: | The proposed approach improves the factual accuracy of LLMs on knowledgeintensive tasks by including in the prompt passages retrieved from an external corpus. |
LLM-Generated Text May Harm Your Retrieval! A Robust Detection Strategy for Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) improves accuracy and timeliness of large language models, but external corpora may become contaminated with LLM-generated texts. |
| Approach: | They propose a method that integrates external knowledge retrieved from external sources into RAG to filter out LLM-generated texts from retrieved results. |
| Outcome: | The proposed method mitigates performance degradation and improves stability of RAG systems. |
Does RAG Introduce Unfairness in LLMs? Evaluating Fairness in Retrieval-Augmented Generation Systems (2025.coling-main)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) models address fairness concerns with respect to sensitive attributes such as gender, geographic location, and other demographic factors. |
| Approach: | They propose a framework to evaluate fairness in RAG using scenario-based questions and analyzing disparities across demographic attributes. |
| Outcome: | The proposed framework analyzes disparities across demographic attributes and identifies fairness issues in retrieval and generation stages. |
PrismRAG: Boosting RAG Factuality with Distractor Resilience and Strategized Reasoning (2025.emnlp-industry)
Copied to clipboard
Mohammad Kachuee, Teja Gollapudi, Minseok Kim, Yin Huang, Kai Sun, Xiao Yang, Jiaqi Wang, Nirav Shah, Yue Liu, Aaron Colak, Anuj Kumar, Wen-tau Yih, Xin Luna Dong
| Challenge: | Existing methods to improve factuality of large language models (LLMs) rely on human-engineered instructions. |
| Approach: | They propose a retrieval-augmented generation framework that trains the model with distractor-aware QA pairs mixing gold evidence with subtle distractor passages and instills reasoning-centric habits that make the LLM plan, rationalize, and synthesize without extensive human engineered instructions. |
| Outcome: | The proposed framework outperforms state-of-the-art solutions across 12 open-book RAG QA benchmarks and is being deployed in production. |
The Mechanics of Interference: Defusing Distractors in RAG via Sparse Autoencoder Interventions (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models exhibit a critical vulnerability to distractor interference when processing retrieval-augmented contexts. |
| Approach: | They propose a mechanistic framework that corrects this failure mode through targeted interventions in the model’s latent space. |
| Outcome: | The proposed framework achieves recovery rates of up to 94% on distractor-vulnerable samples on Gemma-2 and Llama-3 model families across three QA benchmarks. |
Probing-RAG: Self-Probing to Guide Language Models in Selective Document Retrieval (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to optimize retrieve-and-generate processes for real-world scenarios may not be optimal for large language models. |
| Approach: | They propose a Probing-RAG which utilizes hidden state representations from the intermediate layers of language models to adaptively determine the necessity of additional retrievals for a given query. |
| Outcome: | The proposed method outperforms previous methods while reducing the number of redundant retrieval steps. |
Pandora’s Box or Aladdin’s Lamp: A Comprehensive Analysis Revealing the Role of RAG Noise in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) has emerged as a promising approach to address hallucinations in large language models (LLMs). |
| Approach: | They define seven distinct noise types from a linguistic perspective and establish a Noise RAG Benchmark (NoiserBench) they propose to evaluate noise that is beneficial to LLMs and noise that's harmful to LRMs. |
| Outcome: | The proposed framework consists of seven distinct noise types from a linguistic perspective and includes multiple datasets and reasoning tasks. |
Masking or Mitigating? Deconstructing the Impact of Query Rewriting on Retriever Biases in RAG (2026.findings-acl)
Copied to clipboard
| Challenge: | Query enhancement techniques are now standard in retrieval-augmented generation systems, yet their impact on these biases remains unexplored. |
| Approach: | They evaluate query enhancement techniques that improve retrieval quality . they find that simple rewriting reduces bias through increased score variance . no technique uniformly addresses all biases, and effects vary substantially across retrievers . |
| Outcome: | The proposed method achieves strongest aggregate reduction, but fails under adversarial conditions where multiple biases combine. |
How Retrieved Context Shapes Internal Representations in RAG (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is a widely adopted approach for enhancing large language models with external knowledge. |
| Approach: | They analyze how different types of retrieved documents affect the hidden states of large language models and how these internal representation shifts relate to downstream generation behavior. |
| Outcome: | The results show that context relevancy and layer-wise processing influence internal representations, providing explanations of LLMs’ output behaviors and insights for RAG system design. |
How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmark (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior work has not explored the mechanisms underlying this sensitivity. |
| Approach: | They propose a synthetic benchmark to evaluate Large Language Models’ reasoning robustness against systematically controlled irrelevant context (IC). |
| Outcome: | The proposed model improves in-distribution and out-of-disttribution scenarios while training with strong distractors. |