Challenge: Existing evaluation benchmarks for document chunking are inadequate due to evidence sparsity . evaluators are unable to evaluate different chunking methods due to the evidence sparing .
Approach: They propose a QA benchmark for document chunking and a hierarchical document structuring framework for it.
Outcome: The proposed framework improves document chunking quality within reasonable time consumption.

Similar Papers

Document Segmentation Matters for Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Existing rule-based chunking methods lead to suboptimal splits, where overly large chunks introduce irrelevant information and small chunks lack semantic coherence.
Approach: They propose a method that leverages document summaries as pseudo-instructions to guide chunking by computing semantic similarity between sentences and the summary.
Outcome: Experiments on multiple open-domain question-answering benchmarks show that PIC significantly improves retrieval accuracy (Hits@k) and end-to-end QA performance (Exact Match) without any additional training.
Retrieval-Augmented Generation with Hierarchical Knowledge (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing RAG methods do not utilize hierarchical knowledge in human cognition, which limits the capabilities of RAG systems.
Approach: They propose a graph-based approach that utilizes hierarchical knowledge to enhance the semantic understanding and structure capturing capabilities of RAG systems.
Outcome: The proposed approach achieves significant performance improvements over the state-of-the-art methods.
SAKI-RAG: Mitigating Context Fragmentation in Long-Document RAG via Sentence-level Attention Knowledge Integration (2025.emnlp-main)

Copied to clipboard

Challenge: Traditional Retrieval-Augmented Generation (RAG) frameworks segment documents into larger chunks to preserve contextual coherence . however, such chunking methods lead to fragmented contexts, isolated chunk semantics, and broken inter-chunk relationships .
Approach: They propose a framework that maintains granular chunks while recovering their intrinsic semantic connections.
Outcome: The proposed framework achieves better recall and precision compared to other RAG frameworks in long-document retrieval scenarios.
HASH-RAG: Bridging Deep Hashing with Retriever for Efficient, Fine Retrieval and Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Experimental evaluations on NQ, TriviaQA, and HotpotQA datasets demonstrate that our approach achieves a 90% reduction in retrieval time compared to conventional methods while maintaining considerate recall performance.
Approach: They propose a framework that integrates deep hashing techniques with systematic optimizations to address these limitations.
Outcome: The proposed framework outperforms retrieval/non-retrieval baselines by 1.4-4.3% in EM scores on NQ, TriviaQA, and HotpotQA datasets.
HiGoE: Hierarchical Graph of Evidence to Enhance Retrieval-Augmented Generation for Long-context Summarization (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for long-context summarization fail to capture high-level thematic structures and long-range dependencies.
Approach: They propose a hierarchical Graph of Evidence to reduce hallucination and attention dilution by replacing unreliable chunk-based methods with a filtered proposition–evidence graph.
Outcome: Experiments show that HiGoE surpasses baselines in quality and efficiency.
Enhancing Retrieval-Augmented Generation: A Study of Best Practices (2025.coling-main)

Copied to clipboard

Challenge: Retrieval-augmented generation systems have shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.
Approach: They propose to integrate query expansion, various novel retrieval strategies, and a Contrastive In-Context Learning RAG to improve response quality.
Outcome: The proposed RAGs incorporate query expansion, various novel retrieval strategies, and a novel Contrastive In-Context Learning RAG.
MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation System (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for text chunking are limited by text chunks and lack of domain-specific knowledge.
Approach: They propose a dual-metric evaluation method to quantify text chunking quality . they aim to generate a structured list of chunking regular expressions .
Outcome: The proposed method enables direct quantification of chunking quality . it substantiates the need to integrate LLMs into chunking process .
HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: In-depth research on the specific capabilities needed by the RAG generation model is lacking, leading to inconsistent document quality and retrieval system imperfections.
Approach: They propose that RAG models should possess three progressively hierarchical abilities: (1) Filtering: the ability to select relevant information; (2) Combination: the capability to combine semantic information across paragraphs; (3) RAG-specific reasoning: the capacity to further process external knowledge using internal knowledge.
Outcome: Experiments show that the proposed method significantly improves the model’s open-book examination capability on datasets such as RGB, PopQA, MuSiQue, HotpotQA, and PubmedQA.
RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing RAG paradigms often overlook the cognitive step of applying knowledge, leaving a gap between retrieved facts and task-specific reasoning.
Approach: They introduce a module extension that integrates application-aware reasoning into the RAG pipeline.
Outcome: Experiments show that RAG+ outperforms standard RAG variants and achieves gains of 3–5% in complex scenarios.
MS-RAG: Simple and Effective Multi-Semantic Retrieval-Augmented Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for large language models suffer from poor indexing and inference speed . graph-based RAGs heavily rely on LLM for retrieval thus inference slow .
Approach: They propose retrieval-augmented generation (RAG) which integrates knowledge with dense vectors to build a multi-semantic RAG.
Outcome: The proposed method achieves state-of-the-art performance with faster inference speed compared to existing methods .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations