Papers by Lvzhou Luo
AttnComp: Attention-Guided Adaptive Context Compression for Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for augmented large language models suffer from irrelevant retrieved content . existing methods struggle to adapt compression rates for different context, maintain low latency . |
| Approach: | We propose an adaptive, efficient and context-aware compression framework to reduce retrieved content . AttnComp uses a top-p compression algorithm to retain the minimal set of documents whose attention weights exceed a threshold. |
| Outcome: | Experiments show that AttnComp outperforms existing compression methods and uncompressed baselines in achieving higher accuracy with substantial compression rates and lower latency. |
Attention with Dependency Parsing Augmentation for Fine-Grained Attribution (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing fine-grained attribution methods rely on model-internal similarity metrics but lack a fine-grain representation of the data. |
| Approach: | They propose to use model-internal similarity metrics to validate RAG-generated content . they aggregate token-wise evidence through set union operations and integrate dependency parsing to enrich the semantic completeness of target spans. |
| Outcome: | The proposed method outperforms all prior works in the validation of RAG-generated content. |
Navigating Large-Scale Document Collections: MuDABench for Multi-Document Analytical QA (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multi-document QA benchmarks require information from only a few documents with limited cross-document reasoning. |
| Approach: | They propose a benchmark for multi-document analytical QA that extracts and synthesizes information across multiple documents to perform quantitative analysis. |
| Outcome: | The proposed approach improves both process and outcome metrics but still has bottlenecks compared to human experts. |