| Challenge: | Existing chunking paradigms rely on static boundary identification, limiting performance . Existing methods rely only on static knowledge, resulting in hallucinated content . |
| Approach: | They propose a Cross-Granularity Encoding Framework that treats sentences as atomic units and shifts from static chunk segmentation to flexible retrieval supporting arbitrary sentence combinations. |
| Outcome: | The proposed framework avoids the computational overhead required for semantic boundary detection and enhances adaptability to complex queries. |
Similar Papers
Document Segmentation Matters for Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Zhitong Wang, Cheng Gao, Chaojun Xiao, Yufei Huang, Shuzheng Si, Kangyang Luo, Yuzhuo Bai, Wenhao Li, Tangjian Duan, Chuancheng Lv, Guoshan Lu, Gang Chen, Fanchao Qi, Maosong Sun
| Challenge: | Existing rule-based chunking methods lead to suboptimal splits, where overly large chunks introduce irrelevant information and small chunks lack semantic coherence. |
| Approach: | They propose a method that leverages document summaries as pseudo-instructions to guide chunking by computing semantic similarity between sentences and the summary. |
| Outcome: | Experiments on multiple open-domain question-answering benchmarks show that PIC significantly improves retrieval accuracy (Hits@k) and end-to-end QA performance (Exact Match) without any additional training. |
MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation System (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text chunking are limited by text chunks and lack of domain-specific knowledge. |
| Approach: | They propose a dual-metric evaluation method to quantify text chunking quality . they aim to generate a structured list of chunking regular expressions . |
| Outcome: | The proposed method enables direct quantification of chunking quality . it substantiates the need to integrate LLMs into chunking process . |
SAKI-RAG: Mitigating Context Fragmentation in Long-Document RAG via Sentence-level Attention Knowledge Integration (2025.emnlp-main)
Copied to clipboard
| Challenge: | Traditional Retrieval-Augmented Generation (RAG) frameworks segment documents into larger chunks to preserve contextual coherence . however, such chunking methods lead to fragmented contexts, isolated chunk semantics, and broken inter-chunk relationships . |
| Approach: | They propose a framework that maintains granular chunks while recovering their intrinsic semantic connections. |
| Outcome: | The proposed framework achieves better recall and precision compared to other RAG frameworks in long-document retrieval scenarios. |
AutoChunker: Structured Text Chunking and its Evaluation (2025.acl-industry)
Copied to clipboard
| Challenge: | Existing methods for text chunking struggle with document structure and noise . Existing approaches struggle with maintaining semantic coherence while handling complex documents. |
| Approach: | They propose a bottom-up approach to chunking that combines document structure awareness with noise elimination. |
| Outcome: | The proposed method outperforms existing methods in noise reduction, completeness, context coherence, task relevance, and retrieval performance. |
HiChunk: Evaluating and Enhancing Retrieval Augmented Generation with Hierarchical Chunking (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks for document chunking are inadequate due to evidence sparsity . evaluators are unable to evaluate different chunking methods due to the evidence sparing . |
| Approach: | They propose a QA benchmark for document chunking and a hierarchical document structuring framework for it. |
| Outcome: | The proposed framework improves document chunking quality within reasonable time consumption. |
AED-RAG: Continuous Multi-Granular Context Fusion for Retrieval-Augmented Generation via Adaptive Ensemble Decoding (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing alignment strategies that rely on discrete reranking struggle to address this granularity mismatch or effectively balance external evidence with internal knowledge. |
| Approach: | They propose a framework that synergizes discrete retrieval with continuous reranking to discern the information density differences between unstructured narrative passages and structured knowledge triplets. |
| Outcome: | Extensive experiments on four open-domain QA benchmarks show that AED-RAG significantly outperforms competitive baselines. |
LumberChunker: Long-Form Narrative Document Segmentation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Modern NLP tasks rely on dense retrieval methods to access up-to-date and relevant contextual information. |
| Approach: | They propose a method that leverages an LLM to dynamically segment documents by iterating on a set of sequential passages to identify the point where the content begins to shift. |
| Outcome: | The proposed method outperforms the most competitive baseline by 7.37% in retrieval performance and integrates into a RAG pipeline. |
cAST: Enhancing Code Retrieval-Augmented Generation with Structural Chunking via Abstract Syntax Tree (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing line-based chunking heuristics often break semantic structures, splitting functions or merging unrelated code. |
| Approach: | They propose a structure-aware method that breaks large AST nodes into smaller chunks . this method generates self-contained, semantically coherent units across programming languages . |
| Outcome: | The proposed method boosts Recall@5 by 4.3 points on RepoEval retrieval and Pass@1 by 2.67 points on SWE-bench generation. |
Grounding Language Model with Chunking-Free In-Context Retrieval (2024.acl-long)
Copied to clipboard
| Challenge: | CFIC retrieval approach eliminates the need for document chunking and provides a more efficient and efficient method for RAG systems. |
| Approach: | They propose a Chunking-Free In-Context retrieval approach specifically tailored for RAG systems . they employ auto-aggressive decoding to accurately identify specific evidence text . |
| Outcome: | The proposed method is better than traditional methods on open question answering datasets. |
HASH-RAG: Bridging Deep Hashing with Retriever for Efficient, Fine Retrieval and Augmented Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Experimental evaluations on NQ, TriviaQA, and HotpotQA datasets demonstrate that our approach achieves a 90% reduction in retrieval time compared to conventional methods while maintaining considerate recall performance. |
| Approach: | They propose a framework that integrates deep hashing techniques with systematic optimizations to address these limitations. |
| Outcome: | The proposed framework outperforms retrieval/non-retrieval baselines by 1.4-4.3% in EM scores on NQ, TriviaQA, and HotpotQA datasets. |