Papers by Zhe Han
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities (2023.acl-demo)
Copied to clipboard
Zhe Zhao, Yudong Li, Cheng Hou, Jing Zhao, Rong Tian, Weijie Liu, Yiren Chen, Ningyuan Sun, Haoyan Liu, Weiquan Mao, Han Guo, Weigang Gou, Taiqiang Wu, Tao Zhu, Wenhang Shi, Chen Chen, Shan Huang, Sihong Chen, Liqun Liu, Feifei Li, Xiaoshuai Chen, Xingwu Sun, Zhanhui Kang, Xiaoyong Du, Linlin Shen, Kimmo Yan
| Challenge: | Several pre-training models of different modalities are showing a rising trend of homogeneity in their model structures. |
| Approach: | They propose a toolkit that supports pre-training models of different modalities. |
| Outcome: | The proposed toolkit can match the performance of the original implementations on text, vision, and audio benchmarks. |
MARE: Multi-Aspect Rationale Extractor on Unsupervised Rationale Extraction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to extract text snippets from input text to support model predictions without explicit rationale annotation have limited their ability to capture meaningful internal correlations between aspects. |
| Approach: | They propose a multi-aspect rationale extractor that extracts text snippets to support model predictions without explicit rationale annotation. |
| Outcome: | The proposed method achieves state-of-the-art on two unsupervised rationale extraction benchmarks. |
Feedback Is The Key for Automated Survey Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) provide a promising foundation for literature surveys, but guiding them to generate accurate, reliable content remains a fundamental challenge. |
| Approach: | They propose a feedback-driven framework that incorporates feedback across three dimensions: outline feedback for structural clarity, citation feedback for evidence validation, and content feedback for readability and analytical depth. |
| Outcome: | The proposed framework significantly improves both citation and content quality, demonstrating feedback as the critical mechanism for automatic survey generation. |
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching (2022.findings-naacl)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Zhe Zhao, Qi Ju, Xuefeng Yang, Rong Tian, Zhu Tao, Haoyan Liu, Han Guo, Xingyu Bai, Weiquan Mao, Yudong Li, Weigang Guo, Taiqiang Wu, Ningyuan Sun
| Challenge: | Existing studies have shown that cross-lingual knowledge distillation can improve the performance of pre-trained models for cross-linguistic similarity matching tasks. |
| Approach: | They propose a multi-stage distillation framework for constructing a small-size but high-performance cross-lingual model using contrastive learning, bottleneck, and parameter recurrent strategies. |
| Outcome: | The proposed model can compress the size of XLM-R and MiniLM by more than 50% while the performance is only reduced by about 1%. |
When Does Language Matter? Multilingual Instructions Reveal Step-wise Language Sensitivity in Vision-Language-Action Models (2026.acl-long)
Copied to clipboard
| Challenge: | Vision-Language-Action models have shown strong performance in language-conditioned robotic manipulation, yet their robustness to linguistic variation remains poorly understood. |
| Approach: | They propose a step-wise inference-time intervention that aligns representations according to step language sensitivity, significantly improving performance under linguistic variation. |
| Outcome: | The proposed model significantly improves performance under linguistic variation under non-English instructions under language-agnostic steps. |