SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains (2025.naacl-long)
Copied to clipboard
Ran Xu, Hui Liu, Sreyashi Nag, Zhenwei Dai, Yaochen Xie, Xianfeng Tang, Chen Luo, Yang Li, Joyce C. Ho, Carl Yang, Qi He
| Challenge: | Retrieval-augmented generation (RAG) enhances the question answering abilities of large language models (LLMs) however, adapting general-purpose RAG systems to specialized fields poses unique challenges due to distribution shifts and limited access to domain-specific data. |
| Approach: | They propose a method that equips large language models with joint capabilities of question answering and question generation for domain adaptation. |
| Outcome: | Experiments on 11 datasets across three different domains verify the efficacy of SimRAG over baselines by 1.2%–8.6%. |
Similar Papers
RAG-Studio: Towards In-Domain Adaptation of Retrieval Augmented Generation Through Self-Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing RAG systems that use pre-trained LLMs and retrievers often fail in specialized domains and applications. |
| Approach: | They propose a self-aligned training framework that adapts general RAG models to specific domains solely through synthetic data. |
| Outcome: | Experiments on specialized domain corpus, general LLM, and general retriever show that the self-aligned training framework outperforms human-annotated training data in specialized fields. |
Multilingual Retrieval-Augmented Generation for Knowledge-Intensive Question Answering Task (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing studies focus on English as the data language for RAG, resulting in limited coverage of multilingual RAG. |
| Approach: | They propose a method that translates retrieved documents into a common language before generating the response. |
| Outcome: | The proposed approach improves efficiency on knowledge-intensive tasks but introduces inconsistencies due to cross-lingual variations in the retrieved content. |
RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time. |
| Approach: | They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge. |
| Outcome: | The proposed approach improves performance on knowledge-intensive NLP tasks. |
RoseRAG: Robust Retrieval-augmented Generation with Small-scale LLMs via Margin-aware Preference Optimization (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive performance but face high computational costs and latency, limiting their deployment in resource-constrained settings. |
| Approach: | They propose a robust RAG framework for large language models via Margin-aware Preference Optimization to enhance the accuracy and reliability of SLMs. |
| Outcome: | The proposed framework surpasses state-of-the-art benchmarks on three open-domain question answering tasks. |
KERAG: Knowledge-Enhanced Retrieval-Augmented Generation for Advanced Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Traditional Knowledge Graph Question Answering (KGQA) methods rely on semantic parsing to retrieve knowledge strictly necessary for answer generation. |
| Approach: | They propose a retrieval-filtering-summarization pipeline that enhances QA coverage by retrieving a broader subgraph likely to contain relevant information. |
| Outcome: | The proposed pipeline surpasses state-of-the-art solutions by about 7% in quality and exceeds GPT-4o (Tool) by 10-21%. |
Separate the Wheat from the Chaff: Winnowing Down Divergent Views in Retrieval Augmented Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) lack robustness in knowledge-intensive tasks due to noisy or irrelevant retrieved data. |
| Approach: | They propose a multi-agent debate-based RAG framework that integrates external knowledge sources into large language models to improve their accuracy. |
| Outcome: | The proposed framework is unsupervised and leverages pretrained LLMs without fine-tuning, making it easily adaptable to various tasks. |
XRAG: Cross-lingual Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | XRAG evaluates the generation abilities of LLMs in cross-lingual RAG settings where the user language does not match retrieval results. |
| Approach: | They propose a benchmark to evaluate the generation abilities of LLMs in cross-lingual RAG settings where the user language does not match retrieval results. |
| Outcome: | XRAG is a benchmark designed to evaluate the generation abilities of LLMs in cross-lingual RAG settings where the user language does not match retrieval results. |
M-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitions (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for retrieving relevant memories from an external database are coarse-grained and can cause noise and focus on crucial memories. |
| Approach: | They propose a multiple partition paradigm for RAG where each database partition serves as a basic unit for execution. |
| Outcome: | The proposed framework outperforms baseline methods on three language generation tasks on seven datasets. |
Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies show that LLMs face challenges in effectively using retrieved information . authors propose a method that considers LLM as "Information Refiner" |
| Approach: | They propose a method that considers LLMs as "Information Refiners" they propose INFO-RAG, which is low-cost and general across various tasks . |
| Outcome: | The proposed method improves performance of LLaMA2 by 9.39% relative points . it is low-cost and general across various tasks, and is robust and in-context learning is possible . |
RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated excellent performance in numerous tasks but the parameterized knowledge stored within LLMs may be incomplete and hard to incorporate up-to-date knowledge. |
| Approach: | They propose a framework that iteratively decomposes tasks and processes them in three submodules to enhance the model’s problem-solving capabilities. |
| Outcome: | The proposed method outperforms existing benchmarks on GPT3.5, Llama2 and other large language models significantly enhancing factual reasoning capabilities and reducing hallucinations. |