pFedRAG: A Personalized Federated Retrieval-Augmented Generation System with Depth-Adaptive Tiered Embedding Tuning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Personalized Federated RAG framework enables efficient collaborative fine-tuning of embedding models . depth-adaptive tieered Embedding (DATE) architecture is tailored for local data and training results of each client. |
| Approach: | a new Personalized Federated RAG framework is proposed for large language models . the framework enables efficient collaborative fine-tuning of embedding models based on common knowledge . |
| Outcome: | a novel Personalized Federated RAG framework is proposed for large language models . the framework enables efficient collaborative fine-tuning of embedding models based on common knowledge . |
Similar Papers
Federated Retrieval-Augmented Generation: A Systematic Mapping Study (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Federated Retrieval-Augmented Generation (Federated RAG) combines Federated Learning (FL) with Retrieleval-augment Generation (RAG) |
| Approach: | They propose to map literature on Federated Retrieval-Augmented Generation (Federated RAG) this mapping study examines architectural patterns, temporal trends, and key challenges . |
| Outcome: | The proposed framework improves the factual accuracy of language models by grounding outputs in external knowledge. |
Embedding-Free RAG (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) is the current state-of-the-art method for mitigating the shortcomings of large language models. |
| Approach: | They propose a model-agnostic approach to retrieval-augmented generation that leverages generalized reasoning abilities of large language models. |
| Outcome: | Embedding-free RAG outperforms existing state-of-the-art methods in a wide range of domains. |
Separate the Wheat from the Chaff: Winnowing Down Divergent Views in Retrieval Augmented Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) lack robustness in knowledge-intensive tasks due to noisy or irrelevant retrieved data. |
| Approach: | They propose a multi-agent debate-based RAG framework that integrates external knowledge sources into large language models to improve their accuracy. |
| Outcome: | The proposed framework is unsupervised and leverages pretrained LLMs without fine-tuning, making it easily adaptable to various tasks. |
RAG-Studio: Towards In-Domain Adaptation of Retrieval Augmented Generation Through Self-Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing RAG systems that use pre-trained LLMs and retrievers often fail in specialized domains and applications. |
| Approach: | They propose a self-aligned training framework that adapts general RAG models to specific domains solely through synthetic data. |
| Outcome: | Experiments on specialized domain corpus, general LLM, and general retriever show that the self-aligned training framework outperforms human-annotated training data in specialized fields. |
ClusterRAG: Cluster-Based Collaborative Filtering for Personalized Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to Personalized Retrieval-Augmented Generation (RAG) ignore long-term user information and inter-user relationships when constructing retrieval contexts, limiting personalization and the ability to leverage analogous users' knowledge for improved generation quality. |
| Approach: | They propose a Cluster-Based Collaborative Filtering for Personalized Retrieval-Augmented Generation that organizes users into semantically coherent clusters and performs retrieval at both the cluster and document levels via cluster-level similarity and fine-grained ranking. |
| Outcome: | Extensive experiments on the LaMP benchmark show that ClusterRAG integrates seamlessly with different dense retrievers and rankers, and remains effective when paired with both fine-tuned and zero-shot language models. |
SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains (2025.naacl-long)
Copied to clipboard
Ran Xu, Hui Liu, Sreyashi Nag, Zhenwei Dai, Yaochen Xie, Xianfeng Tang, Chen Luo, Yang Li, Joyce C. Ho, Carl Yang, Qi He
| Challenge: | Retrieval-augmented generation (RAG) enhances the question answering abilities of large language models (LLMs) however, adapting general-purpose RAG systems to specialized fields poses unique challenges due to distribution shifts and limited access to domain-specific data. |
| Approach: | They propose a method that equips large language models with joint capabilities of question answering and question generation for domain adaptation. |
| Outcome: | Experiments on 11 datasets across three different domains verify the efficacy of SimRAG over baselines by 1.2%–8.6%. |
UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) has shown substantial promise in improving factual accuracy by grounding model responses with external knowledge relevant to queries. |
| Approach: | They propose a framework to retrieve and integrate knowledge from heterogeneous sources with diverse modalities and granularities. |
| Outcome: | The proposed framework shows superiority over existing methods on 10 benchmarks of multiple modalities. |
RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies focus on question scenarios with clear user intents and concise answers, but it is prevalent that users issue broad, open-ended queries with diverse sub-intents. |
| Approach: | They propose a framework that includes a sub-aspect explorer and a multi-faceted retriever to build a candidate pool of diverse external documents related to these sub-intents. |
| Outcome: | The proposed framework provides comprehensive and satisfying responses to users on two publicly available datasets. |
RoseRAG: Robust Retrieval-augmented Generation with Small-scale LLMs via Margin-aware Preference Optimization (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive performance but face high computational costs and latency, limiting their deployment in resource-constrained settings. |
| Approach: | They propose a robust RAG framework for large language models via Margin-aware Preference Optimization to enhance the accuracy and reliability of SLMs. |
| Outcome: | The proposed framework surpasses state-of-the-art benchmarks on three open-domain question answering tasks. |
MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
Chia-Yuan Chang, Zhimeng Jiang, Vineeth Rakesh, Menghai Pan, Chin-Chia Michael Yeh, Guanchu Wang, Mingzhi Hu, Zhichao Xu, Yan Zheng, Mahashweta Das, Na Zou
| Challenge: | Existing RAG systems struggle with the quality of retrieval documents, causing performance degradation and reducing performance. |
| Approach: | They propose a training-free RAG framework that leverages multiple LLM agents to collaboratively filter and score retrieved documents. |
| Outcome: | The proposed framework outperforms existing RAG frameworks in QA benchmarks and shows superior answer consistency and answer accuracy over baseline methods. |