Papers by Huan Ma
Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens (2026.findings-acl)
Copied to clipboard
Chengshuai Zhao, Zhen Tan, Pingchuan Ma, Dawei Li, Bohan Jiang, Yancheng Wang, Yingzhen Yang, Huan Liu
| Challenge: | Chain-of-Thought (CoT) prompting has been shown to be effective in eliciting structured reasoning from large language models (LLMs). |
| Approach: | They propose a data distribution lens to understand when and why CoT reasoning fails . they propose 'data-based' training that trains LLMs from scratch . |
| Outcome: | The proposed model enables models to generate reasoning trajectories that approximate those observed during training. |
Estimating the Black-box LLM Uncertainty with Distribution-Aligned Adversarial Distillation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing uncertainty quantification methods depend on computationally expensive multiple sampling or internal parameters, which prevents real-time estimation and fails to capture information implicit in the black-box reasoning process. |
| Approach: | They propose a distribution-aligned adjudication architecture to guide a lightweight proxy model to learn the high-quality regions of the output distribution of the black-box LLM. |
| Outcome: | Extensive experiments show that a proxy model even with 1% of the target LLM’s size can achieve reliable uncertainty quantification. |
LATTE: Learning to Think with Vision Specialists (2025.emnlp-main)
Copied to clipboard
Zixian Ma, Jianguo Zhang, Zhiwei Liu, Jieyu Zhang, Juntao Tan, Manli Shu, Juan Carlos Niebles, Shelby Heinecke, Huan Wang, Caiming Xiong, Ranjay Krishna, Silvio Savarese
| Challenge: | Open-source vision-language models excel on simple question-answering tasks, but struggle with complex questions that require both perception and reasoning. |
| Approach: | They propose a family of vision-language models that have LeArned to Think wiTh vision spEcialists by offloading perception to state-of-the-art vision models. |
| Outcome: | The proposed model achieves 4-5% gains over baselines across 6 benchmarks covering both perception and reasoning abilities. |
SimRPD: Optimizing Recruitment Proactive Dialogue Agents through Simulator-Based Data Evaluation and Selection (2026.acl-industry)
Copied to clipboard
Zhiyong Cao, Dunqiang Liu, Qi Dai, Haojun Xu, Huai Yuen Khor, Hao Wang, Huan He, Yafei Liu, Ke Ma, Ruqian Shi, Sicheng Zhou, Sijia Yao
| Challenge: | High-quality data in training proactive dialogue agents is scarce, despite fine-tuning and reinforcement learning . a recent study has shown that the effectiveness of supervised fine-touring is limited by the lack of high-quality, domain-specific training data. |
| Approach: | They propose a framework for training recruitment proactive dialogue agents using a high-fidelity user simulator and a multi-dimensional evaluation framework based on Chain-of-Intention. |
| Outcome: | The proposed framework outperforms existing simulator-based data selection strategies in a real-world recruitment scenario. |
Context-Driven Index Trimming: A Data Quality Perspective to Enhancing Precision of RALMs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research often overlooks the data quality issues within retrieval results, often caused by inaccurate existing vector-distance-based retrieval methods. |
| Approach: | They propose to use Context-Driven Index Trimming framework to capture and regulate consistency between retrieved contexts and modify indexes in the database. |
| Outcome: | Experiments show that the proposed framework can improve answer quality by 3.75% on open-domain question-answering tasks. |