Query Optimization for Parametric Knowledge Refinement in Retrieval-Augmented Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Extract-Refine-Retrieve-Read is a query optimization framework for large language models . it is designed to bridge the pre-retrieval information gap in Retriev-Augmented Generation systems . |
| Approach: | They propose a framework to extract parametric knowledge from Large Language Models and refine them using a specialized query optimizer. |
| Outcome: | The extract-refine-retrieve-read framework outperforms baselines on QA datasets . it is designed to meet the knowledge requirements of large language models (LLMs) |
Similar Papers
Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies show that LLMs face challenges in effectively using retrieved information . authors propose a method that considers LLM as "Information Refiner" |
| Approach: | They propose a method that considers LLMs as "Information Refiners" they propose INFO-RAG, which is low-cost and general across various tasks . |
| Outcome: | The proposed method improves performance of LLaMA2 by 9.39% relative points . it is low-cost and general across various tasks, and is robust and in-context learning is possible . |
On the Role of Long-tail Knowledge in Retrieval Augmented Large Language Models (2024.acl-short)
Copied to clipboard
Dongyang Li, Junbing Yan, Taolin Zhang, Chengyu Wang, Xiaofeng He, Longtao Huang, Hui Xue’, Jun Huang
| Challenge: | Existing RAG methods focus on improving the task performance, without fine-grained process of knowledge. |
| Approach: | They propose a method that detects long-tail knowledge in large language models by analyzing retrieved documents and enhancing queries indiscriminately with retrieved information. |
| Outcome: | The proposed method achieves over 4x speedup in average inference time and consistent performance improvement in downstream tasks compared to existing pipelines. |
Fine-grained Knowledge Enhancement for Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies rely on semantic similarity to retrieve knowledge but ignore fine-grained information within documents. |
| Approach: | They propose a fine-grained knowledge enhancement method to fill knowledge gaps with retrieved external information by a Chain-of-Thought prompting procedure and a decoding enhancement strategy to constrain the document-based decoding process. |
| Outcome: | The proposed method can be applied in a plug-and-play manner to enhance its performance with no additional modules or training process. |
Refiner: Restructure Retrieved Content Efficiently to Advance Question-Answering Capabilities (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are limited by their parametric knowledge, leading to hallucinations in knowledge-extensive tasks. |
| Approach: | They propose an end-to-end extract-and-restructure paradigm that leverages a single decoder-only LLM to adaptively extract query-relevant contents verbatim along with the necessary context. |
| Outcome: | Experiments show that a trained Refiner outperforms state-of-the-art RAG and compressing approaches in multiple tasks. |
RE-RAG: Improving Open-Domain QA Performance and Interpretability with Relevance Estimator in Retrieval-Augmented Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to retrieval augmented generation (RAG) are based on parametric knowledge and external knowledge. |
| Approach: | They propose a weakly supervised method for training a relevance estimator (RE) that provides relative relevance between contexts as previous rerankers did, and provides confidence, which can be used to classify whether given context is useful for answering the given question. |
| Outcome: | The proposed framework improves previously unreferenced large language models and can be trained with a small generator without labels for correct contexts. |
LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing solutions to improve the accuracy of RAG are based on retrieval-augmented generation . however, RAG still faces several challenges in tackling complex multi-hop queries . |
| Approach: | They propose a Missing Information Guided Retrieve-Extraction-Solving paradigm that leverages the identification of missing information to generate a targeted query. |
| Outcome: | The proposed method can extract information from retrieved knowledge and know what is still missing. |
Equipping Retrieval-Augmented Large Language Models with Document Structure Awareness (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to retrieval-augmented generation ignore valuable structure that is crucial for document organization. |
| Approach: | They propose a framework that explicitly incorporates structural information throughout the RAG process. |
| Outcome: | The proposed framework incorporates structural information throughout the RAG process. |
RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time. |
| Approach: | They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge. |
| Outcome: | The proposed approach improves performance on knowledge-intensive NLP tasks. |
Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexity (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent Large Language Models (LLMs) generate factually incorrect answers based on their parametric memory. |
| Approach: | They propose a retrieval-augmented large language model that can dynamically select the most suitable strategy based on query complexity. |
| Outcome: | The proposed approach improves the performance of QA systems on open-domain QA datasets. |
Question Decomposition for Retrieval-Augmented Generation (2025.acl-srw)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is effective for question answering tasks . multi-hop questions, such as "Which company among NVIDIA, Apple, and Google made the biggest profit in 2023?" challenge RAG because relevant facts are often distributed across multiple documents . |
| Approach: | They propose a pipeline that incorporates question decomposition to ground large language models in verifiable external sources. |
| Outcome: | The proposed approach improves retrieval and answer accuracy over standard RAG . multi-hop questions often require multiple documents to support the model . |