Papers by Zining Wang
The Illusion of Specialization: Unveiling the Domain-Invariant "Standing Committee" in Mixture-of-Experts Models (2026.acl-long)
Copied to clipboard
| Challenge: | Mixture of Experts models are widely assumed to achieve domain specialization through sparse routing. |
| Approach: | They propose a framework that analyzes routing behavior at the level of expert groups rather than individual experts. |
| Outcome: | The proposed framework analyzes routing behavior at the level of expert groups rather than individual experts. |
Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review (2025.findings-acl)
Copied to clipboard
Pei Fu, Tongkun Guan, Zining Wang, Zhentao Guo, Chen Duan, Hao Sun, Boming Chen, Qianyi Jiang, Jiayao Ma, Kai Zhou, Junfeng Luo
| Challenge: | Recent advances in vision-language models have unified perception and understanding tasks within Visual Question Answering paradigms. |
| Approach: | They propose to outline timeline, architecture, and pipeline of nearly all TIU MLLMs and review their performance on mainstream benchmarks. |
| Outcome: | The proposed models perform well on mainstream benchmarks and are compared with other models. |
XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaboration (2026.acl-long)
Copied to clipboard
Nuo Chen, Andre Lin HuiKai, Jiaying Wu, Junyi Hou, Zining Zhang, Qian Wang, Xidong Wang, Bingsheng He
| Challenge: | Existing systems are designed for general-purpose scientific text generation and fail to support high-quality scientific writing beyond surface-level polishing. |
| Approach: | They propose a human-AI collaboration framework for academic paper revision based on criteria-guided intent alignment and context-aware modeling. |
| Outcome: | The proposed framework outperforms existing LLMs and rivals the quality of proprietary ones. |
Adaptive Contrastive Knowledge Distillation for BERT Compression (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge distillation methods for BERT implicitly learn discriminative student features by mimicking the teacher features. |
| Approach: | They propose a new knowledge distillation approach called adaptive contrastive knowledge distilling for BERT compression using hidden state features in BERT as explicit supervision to learn discriminative student features. |
| Outcome: | The proposed approach improves on multiple natural language processing tasks. |
On the data requirements of probing (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to probe neural networks are expensive and require large datasets. |
| Approach: | They propose a method to estimate the required number of data samples in probing datasets . they use a classification task to encode a text with a deep neural network . |
| Outcome: | The proposed method estimates the required number of data samples in two probing configurations and proves it is statistically powerful. |
Distribution Prompting: Understanding the Expressivity of Language Models Through the Next-Token Distributions They Can Produce (2025.emnlp-main)
Copied to clipboard
| Challenge: | Autoregressive neural language models (LMs) generate a probability distribution over tokens at each time step given a prompt. |
| Approach: | They propose to find a prompt that induces LMs to output a distribution as close as possible to the target, using either soft or hard gradient-based prompt tuning. |
| Outcome: | The proposed model is able to generate a distribution as close as possible to a target given a prompt, and it can be used to approximate distributions with low or high entropy. |
Half-S: Halving the Scale for Near-Lossless 4-Bit LLM Training (2026.findings-acl)
Copied to clipboard
Jinyang Du, Ruihao Gong, Linghan Ai, Zining Wang, Yunke Peng, Yao Wang, Lei Yan, null Wxuefei, Yaoyuan Wang, Jinyang Guo, Dahua Lin, Xianglong Liu
| Challenge: | Existing 4-bit training pipelines rely on max-scaling, which causes representation collapse . despite this, there are limitations in the accuracy of 4-bit LLM training . |
| Approach: | They propose a scaling strategy that uses half-scaling as a hardware-friendly default . they propose fp4 support that allows for a faster scaling of large language models . |
| Outcome: | The proposed scaling strategy narrows the gap between theoretical optimum and BF16 while maintaining the efficiency benefits of 4-bit training. |