Papers by Luo Yixuan
AttnComp: Attention-Guided Adaptive Context Compression for Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for augmented large language models suffer from irrelevant retrieved content . existing methods struggle to adapt compression rates for different context, maintain low latency . |
| Approach: | We propose an adaptive, efficient and context-aware compression framework to reduce retrieved content . AttnComp uses a top-p compression algorithm to retain the minimal set of documents whose attention weights exceed a threshold. |
| Outcome: | Experiments show that AttnComp outperforms existing compression methods and uncompressed baselines in achieving higher accuracy with substantial compression rates and lower latency. |
Uncovering Limitations of Large Language Models in Information Seeking from Tables (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for Table Information Seeking (TabIS) are lacking in reliable evaluation. |
| Approach: | They propose a benchmark to evaluate the table information seeking abilities of large language models . they use a single-choice question format instead of a text-based evaluation . |
| Outcome: | The proposed benchmark is more reliable than existing models and is available online. |
Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training (2024.emnlp-main)
Copied to clipboard
Yixuan Wang, Xianzhen Luo, Fuxuan Wei, Yijun Liu, Qingfu Zhu, Xuanyu Zhang, Qing Yang, Dongliang Xu, Wanxiang Che
| Challenge: | Existing speculative decoding methods require additional model structure and training processes to assist the model for draft token generation. |
| Approach: | They propose a make some noise training framework that introduces some noise at the input for the model to learn the denoising task. |
| Outcome: | The proposed model improves inference speed by 2.3-2.7x times without compromising model performance. |
Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for person anomaly search fail to address the complexities of real-world security, authors say . Existing approaches fail to detect subtle semantic distinctions, authors argue . |
| Approach: | They propose a framework that decouples retrieval into two stages . structure-aware coarse retrieval and detective squad interaction are proposed . |
| Outcome: | The proposed framework achieves state-of-the-art performance by balancing efficiency and semantic reasoning. |
Guideline Learning for In-Context Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models can perform a task by conditioning on task instructions and a few input-output examples without optimizing any parameters. |
| Approach: | They propose a guideline learning framework for In-context IE which reflectively learns and follows guidelines. |
| Outcome: | The proposed framework improves the performance of in-context IE by synthesizing and following guidelines. |
UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Models (2026.acl-demo)
Copied to clipboard
Qundong Shi, Jie Zhou, Biyuan Lin, Junbo Cui, Guoyang Zeng, Yixuan Zhou, Ziyang Wang, Xin Liu, Zhen Luo, Yudong Wang, Zhiyuan Liu
| Challenge: | Existing evaluation frameworks for audio foundation models are heavily reliant on English, making it difficult to objectively assess models’ performance on Chinese. |
| Approach: | They propose a unified framework that supports 10 languages, 14 task categories, 24 models, and 36 benchmarks with one-command evaluation and real-time leaderboards. |
| Outcome: | The proposed framework supports 10 languages, 14 task categories, 24 models, and 36 benchmarks with one-command evaluation and real-time leaderboards. |
Iterative Self-Correction for Text-Driven Person Re-Identification with Large Vision-Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Person Re-Identification (ReID) adopt a static "one-pass" paradigm, converting images to text once for retrieval. |
| Approach: | They propose a framework that reformulates ReID as an iterative "Think-and-Refine" process. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in complex occlusion scenarios. |
Tandem: Riding Together with Large and Small Language Models for Efficient Reasoning (2026.findings-acl)
Copied to clipboard
Zichuan Fu, Xian Wu, Guojing Li, Yejing Wang, Yijun Chen, Zhao Zihao, Luo Yixuan, Hanyu Yan, Yefeng Zheng, Xiangyu Zhao
| Challenge: | Recent advances in large language models (LLMs) have catalyzed the rise of reasoningintensive inference paradigms, where models perform explicit step-by-step reasoning before generating final answers. |
| Approach: | They propose a large-small LLM collaboration framework that synergizes large and small language models to achieve high-quality reasoning with significantly reduced computational cost. |
| Outcome: | The proposed framework outperforms the mentor LLM while preserving the benefits of the thinking paradigm of LLMs. |
Attention with Dependency Parsing Augmentation for Fine-Grained Attribution (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing fine-grained attribution methods rely on model-internal similarity metrics but lack a fine-grain representation of the data. |
| Approach: | They propose to use model-internal similarity metrics to validate RAG-generated content . they aggregate token-wise evidence through set union operations and integrate dependency parsing to enrich the semantic completeness of target spans. |
| Outcome: | The proposed method outperforms all prior works in the validation of RAG-generated content. |
Navigating Large-Scale Document Collections: MuDABench for Multi-Document Analytical QA (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multi-document QA benchmarks require information from only a few documents with limited cross-document reasoning. |
| Approach: | They propose a benchmark for multi-document analytical QA that extracts and synthesizes information across multiple documents to perform quantitative analysis. |
| Outcome: | The proposed approach improves both process and outcome metrics but still has bottlenecks compared to human experts. |
Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate only one token at each decoding step, leading to high latency. |
| Approach: | They propose a speculative decoding paradigm that stores tokens in an adjacency matrix and employs a breadth-first-search algorithm to construct a draft tree. |
| Outcome: | The proposed method outperforms existing train-free methods by 30% and even a training method by 25%. |
Fine-Grained Image-Text Alignment in Medical Imaging Enables Explainable Cyclic Image-Report Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Fine-grained vision-language models (VLMs) have been widely used for inter-modality local alignment between fixed patches and textual words, but they provide incomplete representations of lesions. |
| Approach: | They propose an Adaptive patch-word Matching model to correlate chest X-ray (CXR) image regions with words in medical reports and apply it to CXR-report generation to provide explicit explanations. |
| Outcome: | The proposed model correlates chest X-ray image regions with words in medical reports and provides explanations for the generation process. |