Papers by Wenshuo Zhao
MuTIS: Enhancing Reasoning Efficiency through Multi Turn Intervention Sampling in Reinforcement Learning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for training large reasoning models with long chain-of-thought (CoT) are limited by the number of parameters and the complexity of the model. |
| Approach: | They propose a framework that leverages multi-turn interventions to produce concise reasoning chains and demonstrates strong scalability. |
| Outcome: | The proposed framework breaks the accuracy-efficiency trade-off by producing concise reasoning chains and demonstrating strong scalability on 7B models. |
CAT: Causal Attention Tuning For Injecting Fine-grained Causal Knowledge into Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing fine-tuning paradigms focus on aligning LLMs with task-specific objectives. |
| Approach: | They propose a pipeline that leverages human priors to automatically generate token-level causal signals and introduce the Re-Attention mechanism to guide training. |
| Outcome: | The proposed pipeline achieves an average improvement of 5.76% on the STG dataset and 1.56% on downstream tasks. |
Steering LLM Thinking with Budget Guidance (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing budget control methods for large language models are inadequate for long reasoning . budget guidance can be used to control reasoning length without fine-tuning . |
| Approach: | They propose a budget guidance method that models a Gamma distribution over remaining thinking length during next-token generation and uses it to guide generation in a soft, token-level manner. |
| Outcome: | The proposed method achieves up to 26% accuracy gain on the MATH-500 benchmark compared to baseline methods while maintaining competitive accuracy with only 63% of the thinking tokens used by the full-thinking model. |