Grounding Language Model with Chunking-Free In-Context Retrieval (2024.acl-long)
Copied to clipboard
| Challenge: | CFIC retrieval approach eliminates the need for document chunking and provides a more efficient and efficient method for RAG systems. |
| Approach: | They propose a Chunking-Free In-Context retrieval approach specifically tailored for RAG systems . they employ auto-aggressive decoding to accurately identify specific evidence text . |
| Outcome: | The proposed method is better than traditional methods on open question answering datasets. |
Similar Papers
MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation System (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text chunking are limited by text chunks and lack of domain-specific knowledge. |
| Approach: | They propose a dual-metric evaluation method to quantify text chunking quality . they aim to generate a structured list of chunking regular expressions . |
| Outcome: | The proposed method enables direct quantification of chunking quality . it substantiates the need to integrate LLMs into chunking process . |
AED-RAG: Continuous Multi-Granular Context Fusion for Retrieval-Augmented Generation via Adaptive Ensemble Decoding (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing alignment strategies that rely on discrete reranking struggle to address this granularity mismatch or effectively balance external evidence with internal knowledge. |
| Approach: | They propose a framework that synergizes discrete retrieval with continuous reranking to discern the information density differences between unstructured narrative passages and structured knowledge triplets. |
| Outcome: | Extensive experiments on four open-domain QA benchmarks show that AED-RAG significantly outperforms competitive baselines. |
RAGulator: Lightweight Out-of-Context Detectors for Grounded Text Generation (2025.emnlp-industry)
Copied to clipboard
| Challenge: | In enterprise settings, Generative AI has received widespread adoption as a tool to uplift employees' productivity. |
| Approach: | They develop lightweight models capable of detecting when LLM-generated text deviates from retrieved source documents semantically. |
| Outcome: | The proposed models outperform open-source alternatives on credit policy and sustainability reports used in the banking industry. |
Document Segmentation Matters for Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Zhitong Wang, Cheng Gao, Chaojun Xiao, Yufei Huang, Shuzheng Si, Kangyang Luo, Yuzhuo Bai, Wenhao Li, Tangjian Duan, Chuancheng Lv, Guoshan Lu, Gang Chen, Fanchao Qi, Maosong Sun
| Challenge: | Existing rule-based chunking methods lead to suboptimal splits, where overly large chunks introduce irrelevant information and small chunks lack semantic coherence. |
| Approach: | They propose a method that leverages document summaries as pseudo-instructions to guide chunking by computing semantic similarity between sentences and the summary. |
| Outcome: | Experiments on multiple open-domain question-answering benchmarks show that PIC significantly improves retrieval accuracy (Hits@k) and end-to-end QA performance (Exact Match) without any additional training. |
Enhancing RAG Efficiency with Adaptive Context Compression (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods apply fixed compression rates, over-compressing simple queries or under-compressed complex ones. |
| Approach: | a new framework uses a hierarchical compressor and a context selector to optimize inference efficiency . a framework that dynamically adjusts compression rates based on input complexity optimizes inference without loss of accuracy. |
| Outcome: | Adaptive Context Compression for RAG outperforms fixed-rate methods on Wikipedia and five QA datasets . |
HASH-RAG: Bridging Deep Hashing with Retriever for Efficient, Fine Retrieval and Augmented Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Experimental evaluations on NQ, TriviaQA, and HotpotQA datasets demonstrate that our approach achieves a 90% reduction in retrieval time compared to conventional methods while maintaining considerate recall performance. |
| Approach: | They propose a framework that integrates deep hashing techniques with systematic optimizations to address these limitations. |
| Outcome: | The proposed framework outperforms retrieval/non-retrieval baselines by 1.4-4.3% in EM scores on NQ, TriviaQA, and HotpotQA datasets. |
SAKI-RAG: Mitigating Context Fragmentation in Long-Document RAG via Sentence-level Attention Knowledge Integration (2025.emnlp-main)
Copied to clipboard
| Challenge: | Traditional Retrieval-Augmented Generation (RAG) frameworks segment documents into larger chunks to preserve contextual coherence . however, such chunking methods lead to fragmented contexts, isolated chunk semantics, and broken inter-chunk relationships . |
| Approach: | They propose a framework that maintains granular chunks while recovering their intrinsic semantic connections. |
| Outcome: | The proposed framework achieves better recall and precision compared to other RAG frameworks in long-document retrieval scenarios. |
SARA: Selective and Adaptive Retrieval-augmented Generation with Context Compression (2026.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) extends large language models with external knowledge, but it must balance limited effective context, redundant retrieved evidence, and the loss of fine-grained facts. |
| Approach: | They propose a hybrid RAG framework that uses natural-language snippets and semantic compression vectors to preserve passages in text form and compress remaining evidence into interpretable vectors for iterative evidence reranking. |
| Outcome: | The proposed framework improves answer relevance, answer correctness and semantic similarity across 9 datasets and 5 open-source LLMs. |
Fine-grained Knowledge Enhancement for Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies rely on semantic similarity to retrieve knowledge but ignore fine-grained information within documents. |
| Approach: | They propose a fine-grained knowledge enhancement method to fill knowledge gaps with retrieved external information by a Chain-of-Thought prompting procedure and a decoding enhancement strategy to constrain the document-based decoding process. |
| Outcome: | The proposed method can be applied in a plug-and-play manner to enhance its performance with no additional modules or training process. |
Data-Centric Perspectives on Agentic Retrieval-Augmented Generation: A Survey (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) excel at natural language understanding and generation, yet rely on static pre-training data. |
| Approach: | They propose to augment Large Language Models with external retrieval to ground model outputs . traditional RAG is constrained by a fixed retrieve-then-generate routine . authors aim to guide creation of high-quality datasets for next generation of adaptive LLM agents . |
| Outcome: | The proposed model can decompose tasks, issue exploratory queries, and refine evidence through iterative retrieval. |