Challenge: Existing methods to detect and use hard distracting passages in RAG can cause problems . retrieved passages contain irrelevant but semantically related information that may mislead the LLM .
Approach: They propose a method to identify and use hard distracting passages to improve RAG . they find that adding retrieved passages is found to ground the LLM response .
Outcome: The proposed method achieves up to 7.5% increase in answering accuracy compared to fine-tuned datasets.

Similar Papers

Do RAG Systems Really Suffer From Positional Bias? (2025.emnlp-main)

Copied to clipboard

Challenge: Retrieval Augmented Generation (RAG) improves the factual accuracy of LLMs on knowledgeintensive tasks by including in the prompt passages retrieved from an external corpus.
Approach: They propose to use a retrieval algorithm to add passages from an external corpus to the LLM prompt to improve the factual accuracy of LLMs.
Outcome: The proposed approach improves the factual accuracy of LLMs on knowledgeintensive tasks by including in the prompt passages retrieved from an external corpus.
LLM-Generated Text May Harm Your Retrieval! A Robust Detection Strategy for Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) improves accuracy and timeliness of large language models, but external corpora may become contaminated with LLM-generated texts.
Approach: They propose a method that integrates external knowledge retrieved from external sources into RAG to filter out LLM-generated texts from retrieved results.
Outcome: The proposed method mitigates performance degradation and improves stability of RAG systems.
Does RAG Introduce Unfairness in LLMs? Evaluating Fairness in Retrieval-Augmented Generation Systems (2025.coling-main)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) models address fairness concerns with respect to sensitive attributes such as gender, geographic location, and other demographic factors.
Approach: They propose a framework to evaluate fairness in RAG using scenario-based questions and analyzing disparities across demographic attributes.
Outcome: The proposed framework analyzes disparities across demographic attributes and identifies fairness issues in retrieval and generation stages.
PrismRAG: Boosting RAG Factuality with Distractor Resilience and Strategized Reasoning (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods to improve factuality of large language models (LLMs) rely on human-engineered instructions.
Approach: They propose a retrieval-augmented generation framework that trains the model with distractor-aware QA pairs mixing gold evidence with subtle distractor passages and instills reasoning-centric habits that make the LLM plan, rationalize, and synthesize without extensive human engineered instructions.
Outcome: The proposed framework outperforms state-of-the-art solutions across 12 open-book RAG QA benchmarks and is being deployed in production.
The Mechanics of Interference: Defusing Distractors in RAG via Sparse Autoencoder Interventions (2026.findings-acl)

Copied to clipboard

Challenge: Large language models exhibit a critical vulnerability to distractor interference when processing retrieval-augmented contexts.
Approach: They propose a mechanistic framework that corrects this failure mode through targeted interventions in the model’s latent space.
Outcome: The proposed framework achieves recovery rates of up to 94% on distractor-vulnerable samples on Gemma-2 and Llama-3 model families across three QA benchmarks.
Probing-RAG: Self-Probing to Guide Language Models in Selective Document Retrieval (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods to optimize retrieve-and-generate processes for real-world scenarios may not be optimal for large language models.
Approach: They propose a Probing-RAG which utilizes hidden state representations from the intermediate layers of language models to adaptively determine the necessity of additional retrievals for a given query.
Outcome: The proposed method outperforms previous methods while reducing the number of redundant retrieval steps.
Pandora’s Box or Aladdin’s Lamp: A Comprehensive Analysis Revealing the Role of RAG Noise in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) has emerged as a promising approach to address hallucinations in large language models (LLMs).
Approach: They define seven distinct noise types from a linguistic perspective and establish a Noise RAG Benchmark (NoiserBench) they propose to evaluate noise that is beneficial to LLMs and noise that's harmful to LRMs.
Outcome: The proposed framework consists of seven distinct noise types from a linguistic perspective and includes multiple datasets and reasoning tasks.
Masking or Mitigating? Deconstructing the Impact of Query Rewriting on Retriever Biases in RAG (2026.findings-acl)

Copied to clipboard

Challenge: Query enhancement techniques are now standard in retrieval-augmented generation systems, yet their impact on these biases remains unexplored.
Approach: They evaluate query enhancement techniques that improve retrieval quality . they find that simple rewriting reduces bias through increased score variance . no technique uniformly addresses all biases, and effects vary substantially across retrievers .
Outcome: The proposed method achieves strongest aggregate reduction, but fails under adversarial conditions where multiple biases combine.
How Retrieved Context Shapes Internal Representations in RAG (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is a widely adopted approach for enhancing large language models with external knowledge.
Approach: They analyze how different types of retrieved documents affect the hidden states of large language models and how these internal representation shifts relate to downstream generation behavior.
Outcome: The results show that context relevancy and layer-wise processing influence internal representations, providing explanations of LLMs’ output behaviors and insights for RAG system design.
How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmark (2025.emnlp-main)

Copied to clipboard

Challenge: Prior work has not explored the mechanisms underlying this sensitivity.
Approach: They propose a synthetic benchmark to evaluate Large Language Models’ reasoning robustness against systematically controlled irrelevant context (IC).
Outcome: The proposed model improves in-distribution and out-of-disttribution scenarios while training with strong distractors.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations