Papers by Chun Yuan
DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding (2026.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive (AR) decoding in large language models is latency-bounded by strictly sequential token generation. |
| Approach: | They propose a diffusion-based drafter that proposes multi-token candidates and then verifies them in parallel by the target model. |
| Outcome: | The proposed drafter generates multi-token proposals in a single forward pass while remaining compatible with standard AR verifiers. |
IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing quantization methods are compromising performance of large language models (LLMs) despite their high computational intensity, LLMs are still demanding intensive computation. |
| Approach: | They propose to generate the KV cache of pivot tokens losslessly from the full-precision model. |
| Outcome: | The proposed method generates the KV cache of pivot tokens losslessly from the full-precision model with no extra inference overhead. |
Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation (2023.acl-long)
Copied to clipboard
| Challenge: | Recent success of natural language processing (NLP) is driven by the adoption of large-scale pretrained language models. |
| Approach: | They propose a method to determine the impact of distillation influence on student generalization ability by prioritizing samples likely to enhance the student's generalization abilities. |
| Outcome: | The proposed method outperforms 10 common knowledge distillation baselines on 6 text classification tasks in the GLUE benchmark. |
PRIME: A Process-Outcome Alignment Benchmark for Verifiable Reasoning in Mathematics and Engineering (2026.acl-long)
Copied to clipboard
Xiangfeng Wang, Hangyu Guo, Yanlin Lai, Mitt Huang, Liang Zhao, Chengyuan Yao, Yinmin Zhang, Qi Han, null Xiaoxiaoren, Chun Yuan, Tong Xu, Zheng Ge, Xiangyu Zhang, Daxin Jiang
| Challenge: | Current outcome-centric verification paradigms neglect potential errors in the derivation process. |
| Approach: | They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**. |
| Outcome: | The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models. |
Efficient Transformer Parameter Reuse via Zero-Token Mechanism (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to scaling up parameter counts are impractical for users with limited computational resources. |
| Approach: | They propose a decoupled parameter cycling strategy that employs a head-tail decoupling strategy to decouple the first (head) and last (tail) layers from the parameter cycling process. |
| Outcome: | The proposed approach achieves superior performance under strict parameter constraints and significantly reduces computational overhead via early exits. |
Structural Supervision for Word Alignment and Machine Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge on syntactic structure neglects the rich structural information from target tokens and the structural similarity between the source and target sentences. |
| Approach: | They propose to incorporate syntactic structure of both source and target tokens into the encoder-decoder framework, tightly correlating the internal logic of word alignment and machine translation for multi-task learning. |
| Outcome: | The proposed method outperforms baselines on four publicly available language pairs and consistently outperformed baselines in alignment accuracy and translation quality. |
LET: Leveraging Error Type Information for Grammatical Error Correction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for grammatical error correction (GEC) are mainly divided into detection-based and end-to-end generative models. |
| Approach: | They propose an end-to-end framework which Leverages Error Type (LET) information in the generation process to introduce more convincing error type information. |
| Outcome: | The proposed framework outperforms existing methods on various datasets by a clear margin. |
Bridge the Gap: High-level Semantic Planning for Image Captioning (2020.coling-main)
Copied to clipboard
| Challenge: | Recent image captioning models have improved the multi-modal interaction, such as attention mechanisms. |
| Approach: | They propose a high-level semantic planning mechanism that integrates a semantic reconstruction and an explicit order planning mechanism to bridge the gap between visual and language domains. |
| Outcome: | The proposed model outperforms previous methods and achieves the state-of-the-art performance on MS COCO. |