Challenge: Recent advances in Retrieval-Augmented Generation (RAG) systems have popularized semantic chunking.
Approach: They evaluate the effectiveness of semantic chunking using three common retrieval tasks . they find that the computational costs associated with semantic chunks are not justified by consistent performance gains.
Outcome: The proposed semantic chunking approach is not able to deliver consistent performance gains in three retrieval-related tasks.

Similar Papers

Document Segmentation Matters for Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing rule-based chunking methods lead to suboptimal splits, where overly large chunks introduce irrelevant information and small chunks lack semantic coherence.
Approach: They propose a method that leverages document summaries as pseudo-instructions to guide chunking by computing semantic similarity between sentences and the summary.
Outcome: Experiments on multiple open-domain question-answering benchmarks show that PIC significantly improves retrieval accuracy (Hits@k) and end-to-end QA performance (Exact Match) without any additional training.
MS-RAG: Simple and Effective Multi-Semantic Retrieval-Augmented Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for large language models suffer from poor indexing and inference speed . graph-based RAGs heavily rely on LLM for retrieval thus inference slow .
Approach: They propose retrieval-augmented generation (RAG) which integrates knowledge with dense vectors to build a multi-semantic RAG.
Outcome: The proposed method achieves state-of-the-art performance with faster inference speed compared to existing methods .
Is Agentic RAG worth it? An experimental comparison of RAG approaches (2026.acl-industry)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) systems have several limitations, including noisy or suboptimal retrieval, misuse of retrieval for out-of-scope queries, weak query–document matching, and variability or cost associated with the generator.
Approach: They propose to use a "Enhanced" RAG to address weaknesses in the workflow . they propose to orchestrate the entire process, deciding which actions to perform, when to perform them, and whether to iterate .
Outcome: The proposed models address shortcomings in the RAG workflow, and provide practical insights into the trade-offs between them.
MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation System (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for text chunking are limited by text chunks and lack of domain-specific knowledge.
Approach: They propose a dual-metric evaluation method to quantify text chunking quality . they aim to generate a structured list of chunking regular expressions .
Outcome: The proposed method enables direct quantification of chunking quality . it substantiates the need to integrate LLMs into chunking process .
RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time.
Approach: They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge.
Outcome: The proposed approach improves performance on knowledge-intensive NLP tasks.
Question Decomposition for Retrieval-Augmented Generation (2025.acl-srw)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is effective for question answering tasks . multi-hop questions, such as "Which company among NVIDIA, Apple, and Google made the biggest profit in 2023?" challenge RAG because relevant facts are often distributed across multiple documents .
Approach: They propose a pipeline that incorporates question decomposition to ground large language models in verifiable external sources.
Outcome: The proposed approach improves retrieval and answer accuracy over standard RAG . multi-hop questions often require multiple documents to support the model .
cAST: Enhancing Code Retrieval-Augmented Generation with Structural Chunking via Abstract Syntax Tree (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing line-based chunking heuristics often break semantic structures, splitting functions or merging unrelated code.
Approach: They propose a structure-aware method that breaks large AST nodes into smaller chunks . this method generates self-contained, semantically coherent units across programming languages .
Outcome: The proposed method boosts Recall@5 by 4.3 points on RepoEval retrieval and Pass@1 by 2.67 points on SWE-bench generation.
HiChunk: Evaluating and Enhancing Retrieval Augmented Generation with Hierarchical Chunking (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation benchmarks for document chunking are inadequate due to evidence sparsity . evaluators are unable to evaluate different chunking methods due to the evidence sparing .
Approach: They propose a QA benchmark for document chunking and a hierarchical document structuring framework for it.
Outcome: The proposed framework improves document chunking quality within reasonable time consumption.
HASH-RAG: Bridging Deep Hashing with Retriever for Efficient, Fine Retrieval and Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Experimental evaluations on NQ, TriviaQA, and HotpotQA datasets demonstrate that our approach achieves a 90% reduction in retrieval time compared to conventional methods while maintaining considerate recall performance.
Approach: They propose a framework that integrates deep hashing techniques with systematic optimizations to address these limitations.
Outcome: The proposed framework outperforms retrieval/non-retrieval baselines by 1.4-4.3% in EM scores on NQ, TriviaQA, and HotpotQA datasets.
Searching for Best Practices in Retrieval-Augmented Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, especially in specialized domains.
Approach: They propose several strategies for deploying RAG that balance performance and efficiency.
Outcome: The proposed approaches can significantly enhance question-answering capabilities and accelerate the generation of multimodal content using a “retrieval as generation” strategy.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations