Papers by Cunxiao Du
LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can process extremely long contexts, requiring efficient inference over extended inputs. |
| Approach: | They propose a model that uses a constant-sized key-value cache to train long-context models. |
| Outcome: | Experimental results show that LongSpec achieves 3.26x speedup over strong Flash Attention baselines and 2.34x wall clock time on four math reasoning tasks. |
Reverse Modeling in Large Language Models (2025.naacl-short)
Copied to clipboard
| Challenge: | Using pre-trained LLMs with reversed text inputs can improve their performance across multiple languages. |
| Approach: | They propose a way to determine whether LLMs can understand reversed text inputs by reversing entire paragraphs or documents at the token level. |
| Outcome: | The proposed model can be used to improve understanding across multiple languages. |
Revisiting the Markov Property for Machine Translation (2024.findings-eacl)
Copied to clipboard
| Challenge: | Statistical machine translation (SMT) has employed Markov models, but autoregressive models are less effective. |
| Approach: | They propose to use a Markov Autoregressive Transformer to model neural machine translation using four WMT benchmarks. |
| Outcome: | The proposed model performs better than autoregressive models on four WMT benchmarks. |
ngram-OAXE: Phrase-Based Order-Agnostic Cross Entropy for Non-Autoregressive Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Recent studies have incorporated approaches to improving the standard cross-entropy loss to ameliorate the effect of multimodality. |
| Approach: | They propose a new training oaxe loss which removes the penalty of word order errors in the standard cross-entropy loss. |
| Outcome: | Extensive experiments on NAT benchmarks show that the proposed approach improves translation quality and improves model performance. |
Sparse-to-Dense: A Free Lunch for Lossless Acceleration of Video Understanding in LLMs (2025.acl-short)
Copied to clipboard
| Challenge: | Recent advances in Video Large Language Models (Video-LLMs) have achieved exceptional performance on tasks like video question answering and captioning. |
| Approach: | They propose a decoding strategy that leverages sparse top-K attention and dense full attention to accelerate Video-LLMs without loss. |
| Outcome: | The proposed approach achieves a 1.94 walltime speedup in video processing. |
Merlin’s Whisper: Enabling Efficient Reasoning in Large Language Models via Black-box Persuasive Prompting (2026.acl-long)
Copied to clipboard
| Challenge: | Large reasoning models (LRMs) have demonstrated proficiency in tackling complex tasks through step-by-step thinking. |
| Approach: | They propose a black-box persuasive prompting framework that generates concise responses without compromising accuracy. |
| Outcome: | The proposed framework reduces token usage while preserving performance. |