Challenge: Existing studies have shown that LLMs struggle to identify the boundaries of their own knowledge and tend to prioritize external information over internal knowledge learned during pre-training.
Approach: They conduct a comprehensive analysis of LLM representation behaviors and demonstrate the significance of using representations in knowledge checking.
Outcome: The proposed classifiers improve performance even when dealing with noisy knowledge databases.

Similar Papers

A Survey of RAG-Reasoning Systems in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: a survey of RAG-based reasoning-based approaches shows that it is not effective for multi-step inferences.
Approach: They map how advanced reasoning optimizes each stage of RAG . they show how retrieved knowledge supply missing premises and expand context for complex inference .
Outcome: The proposed frameworks achieve state-of-the-art across knowledge-intensive benchmarks.
Enhancing Retrieval-Augmented Generation: A Study of Best Practices (2025.coling-main)

Copied to clipboard

Challenge: Retrieval-augmented generation systems have shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.
Approach: They propose to integrate query expansion, various novel retrieval strategies, and a Contrastive In-Context Learning RAG to improve response quality.
Outcome: The proposed RAGs incorporate query expansion, various novel retrieval strategies, and a novel Contrastive In-Context Learning RAG.
LLM-Generated Text May Harm Your Retrieval! A Robust Detection Strategy for Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) improves accuracy and timeliness of large language models, but external corpora may become contaminated with LLM-generated texts.
Approach: They propose a method that integrates external knowledge retrieved from external sources into RAG to filter out LLM-generated texts from retrieved results.
Outcome: The proposed method mitigates performance degradation and improves stability of RAG systems.
Searching for Best Practices in Retrieval-Augmented Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, especially in specialized domains.
Approach: They propose several strategies for deploying RAG that balance performance and efficiency.
Outcome: The proposed approaches can significantly enhance question-answering capabilities and accelerate the generation of multimodal content using a “retrieval as generation” strategy.
RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time.
Approach: They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge.
Outcome: The proposed approach improves performance on knowledge-intensive NLP tasks.
Retrieval-augmented Generation across Heterogeneous Knowledge (2022.naacl-srw)

Copied to clipboard

Challenge: Existing methods for retrieving knowledge from a single source homogeneous corpus have been gaining increasing attention in the field of natural language processing (NLP) however, they still suffer from the following drawbacks: (i) They are usually trained offline, making the model agnostic to the latest information, e.g., asking a chat-bot about COVID-19.
Approach: They propose to use a single-source homogeneous corpus to generate retrieval-augmented generation models that can learn from the pre-training corpus.
Outcome: The proposed methods have been applied to various knowledge-intensive NLP tasks, but most of the work has focused on retrieving unstructured text documents from Wikipedia.
RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation (2024.emnlp-demo)

Copied to clipboard

Challenge: Existing research on Retrieval Augmented Generation (RAG) does not address the problem of hallucinations and real-time updating of knowledge.
Approach: They propose a modular open-source library to equip LLMs with external knowledge.
Outcome: The proposed approach reduces the need for expensive open-source tools and lacks fair comparisons between novel RAG algorithms.
Know Your RAG: Dataset Taxonomy and Generation Strategies for Evaluating RAG Systems (2025.coling-industry)

Copied to clipboard

Challenge: Retrieval Augmented Generation (RAG) systems are widespread in the industry.
Approach: They propose to use Q&A datasets to assess retrieval performance and label-targeted data generation to refine RAG datasets.
Outcome: The proposed system can generate Q&A datasets with fine-tuned small LLMs.
CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on detecting LLM’s confidence via statistical uncertainty.
Approach: They propose to use a representation perspective to solve adaptive RAG by enabling dynamic retrieval during generation and enabling retrieval only when the query exceeds LLM's internal knowledge.
Outcome: The proposed framework is superior to existing adaptive RAG methods on a diverse set of tasks.
How Does Knowledge Selection Help Retrieval Augmented Generation? (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is a powerful method for enhancing natural language generation by integrating external knowledge into a model’s output.
Approach: They empirically analyze how knowledge selection influences downstream generation performance in RAG systems by simulating different retrieval and selection conditions through a controlled mixture of gold and distractor knowledge.
Outcome: The proposed model is based on a controlled mixture of gold and distractor knowledge and simulated with a gold and distractors.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations