Select to Know: An Internal-External Knowledge Self-Selection Framework for Domain-Specific Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) perform well in general QA but often struggle in domain-specific scenarios. |
| Approach: | They propose a framework that internalizes domain knowledge through internal-external knowledge self-selection and selective supervised fine-tuning. |
| Outcome: | The proposed framework outperforms existing methods and matches domain-pretrained LLMs with significantly lower cost. |
Similar Papers
Systematic Knowledge Injection into Large Language Models via Diverse Augmentation for Domain-Specific RAG (2025.findings-naacl)
Copied to clipboard
Kushagra Bhushan, Yatin Nandwani, Dinesh Khandelwal, Sonam Gupta, Gaurav Pandey, Dinesh Raghu, Sachindra Joshi
| Challenge: | Retrieval-Augmented Generation (RAG) enhances response relevance by incorporating retrieved domain knowledge in the context, retrieval errors can still lead to hallucinations and incorrect answers. |
| Approach: | They propose a framework that augments the learning process by context augmentation and knowledge paraphrasing by incorporating retrieved domain knowledge into the context. |
| Outcome: | The proposed framework achieves 10% relative gain in token-level recall while preserving the LLM’s generalization capabilities. |
REAR: A Relevance-Aware Retrieval-Augmented Framework for Open-Domain Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to extend knowledge scope of large language models (LLMs) lack internal parametric knowledge, resulting in misusing external knowledge. |
| Approach: | They propose a retrieval-augmented approach that provides LLMs with potentially relevant documents through a module. |
| Outcome: | The proposed approach outperforms existing methods on four open-domain QA tasks. |
Self-Knowledge Guided Retrieval Augmentation for Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown superior performance without task-specific fine-tuning due to the computational costs. |
| Approach: | They propose a method which lets LLMs refer to the questions they have previously encountered and adaptively call for external resources when dealing with new questions. |
| Outcome: | The proposed method outperforms chain-of-thought based and fully retrieval-based methods on multiple datasets and outperformed chain- of-though, chatGPT and InstructGPT. |
Efficient and Effective Internal Memory Retrieval for LLM-Based Healthcare Prediction (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to ground large language models in external knowledge are limited by hallucinations and a lack of granular medical context. |
| Approach: | They propose a framework that replaces external retrieval with internal, key-based knowledge access by encoding clinical information directly into the model’s parameter space. |
| Outcome: | The proposed framework achieves state-of-the-art performance across four benchmark healthcare outcome prediction datasets. |
RAG-Studio: Towards In-Domain Adaptation of Retrieval Augmented Generation Through Self-Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing RAG systems that use pre-trained LLMs and retrievers often fail in specialized domains and applications. |
| Approach: | They propose a self-aligned training framework that adapts general RAG models to specific domains solely through synthetic data. |
| Outcome: | Experiments on specialized domain corpus, general LLM, and general retriever show that the self-aligned training framework outperforms human-annotated training data in specialized fields. |
Bridging External and Parametric Knowledge: Mitigating Hallucination of LLMs with Shared-Private Semantic Synergy in Dual-Stream Knowledge (2025.emnlp-main)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) aims to mitigate the hallucination of Large Language Models (LLMs) however, external knowledge may contain noise and conflict with parametric knowledge of LLMs, leading to degraded performance. |
| Approach: | They propose a Dual-Stream Knowledge-Augmented Framework for Shared-Private Semantic Synergy that refines the traditional self-attention into a mixed-attention that distinguishes shared and private semantics for a controlled knowledge integration. |
| Outcome: | Extensive experiments show that the proposed framework achieves a superior performance over baselines. |
Probing-RAG: Self-Probing to Guide Language Models in Selective Document Retrieval (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to optimize retrieve-and-generate processes for real-world scenarios may not be optimal for large language models. |
| Approach: | They propose a Probing-RAG which utilizes hidden state representations from the intermediate layers of language models to adaptively determine the necessity of additional retrievals for a given query. |
| Outcome: | The proposed method outperforms previous methods while reducing the number of redundant retrieval steps. |
Smart-Searcher: Incentivizing the Dynamic Knowledge Acquisition of LLMs via Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
Huatong Song, Jinhao Jiang, Wenqing Tian, Zhipeng Chen, Yuhuan Wu, Jiahao Zhao, Yingqian Min, Xin Zhao, Lei Fang, Ji-Rong Wen
| Challenge: | Large Language Models (LLMs) are powerful but prone to hallucinations due to static knowledge. Retrieval-augmented generation (RAG) helps by injecting external information, but current methods are costly, generalize poorly, or ignore the model’s internal knowledge. |
| Approach: | They propose a framework to train large language models to leverage both internal and external knowledge sources. |
| Outcome: | The proposed framework outperforms existing methods and achieves efficient retrieval-augmented reasoning. |
LLM-Independent Adaptive RAG: Let the Question Speak for Itself (2025.emnlp-main)
Copied to clipboard
Maria Marina, Nikolay Ivanov, Sergey Pletenev, Mikhail Salnikov, Daria Galimzianova, Nikita Krayko, Vasily Konovalov, Alexander Panchenko, Viktor Moskvoretskii
| Challenge: | Existing methods to retrieve Large Language Models (LLMs) are inefficient and impractical. |
| Approach: | They propose a lightweight adaptive retrieval method that leverages external information to achieve comparable quality while achieving significant efficiency gains. |
| Outcome: | The proposed methods achieve comparable quality while achieving significant efficiency gains on 6 QA datasets. |
SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains (2025.naacl-long)
Copied to clipboard
Ran Xu, Hui Liu, Sreyashi Nag, Zhenwei Dai, Yaochen Xie, Xianfeng Tang, Chen Luo, Yang Li, Joyce C. Ho, Carl Yang, Qi He
| Challenge: | Retrieval-augmented generation (RAG) enhances the question answering abilities of large language models (LLMs) however, adapting general-purpose RAG systems to specialized fields poses unique challenges due to distribution shifts and limited access to domain-specific data. |
| Approach: | They propose a method that equips large language models with joint capabilities of question answering and question generation for domain adaptation. |
| Outcome: | Experiments on 11 datasets across three different domains verify the efficacy of SimRAG over baselines by 1.2%–8.6%. |