Papers by Xiao-Wen Chang
EvoEdit: Evolving Null-space Alignment for Robust and Efficient Knowledge Editing (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to modifying large language models require continual updates to rectify outdated or erroneous knowledge. |
| Approach: | They propose a model editing strategy that mitigates catastrophic interference through sequential null-space alignment. |
| Outcome: | EvoEdit achieves better or comparable performance than prior state-of-the-art techniques with up to 3.53 speedup. |
MARS: Unleashing the Power of Speculative Decoding via Margin-Aware Verification (2026.findings-acl)
Copied to clipboard
Jingwei Song, Xinyu Wang, Hanbin Wang, Xiaoxuan Lei, Tianyu Shi, Shixin Han, Eric Yang, Xiao-Wen Chang, Lynn Ai
| Challenge: | Autoregressive large language models suffer from high inference latency due to memorybandwidth constraints. |
| Approach: | They propose a method that decouples generation and verification by decoupling tokens and a lightweight draft model. |
| Outcome: | The proposed method delivers consistent and significant speedups over state-of-the-art baselines while preserving generation quality across diverse benchmarks. |
Improving Context Fidelity via Native Retrieval-Augmented Reasoning (2025.emnlp-main)
Copied to clipboard
Suyuchen Wang, Jinlin Wang, Xinyu Wang, Shiqi Li, Xiangru Tang, Sirui Hong, Xiao-Wen Chang, Chenglin Wu, Bang Liu
| Challenge: | Existing approaches to fidelity to contexts rely on expensive supervised fine-tuning to generate evidence post-answer or train models to perform web searches without improving utilization of the given context. |
| Approach: | They propose a native retrieval-augmented reasoning framework that integrates in-context evidence with the model’s own retrieval capabilities. |
| Outcome: | The proposed approach outperforms supervised fine-tuning, retrieval-augmented generation methods, and external retrieval solutions on multiple real-world and counterfactual QA benchmarks. |