Papers by Zeliang Zhang
1+1>2: A Synergistic Sparse and Low-Rank Compression Method for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Low-rank approximation compresses the model by retaining its essential structure with minimal information loss. |
| Approach: | They propose a method that leverages the strengths of pruning and low-rank approximation for LLMs. |
| Outcome: | The proposed methods surpass the existing methods on LLaMA and Qwen2.5 models. |
Can CLIP Count Stars? An Empirical Study on Quantity Bias in CLIP (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Despite its versatility, CLIP-based applications often suffer from misunderstandings regarding user intent, leading to discrepancies between the required number of objects and the actual outputs. |
| Approach: | They empirically evaluate CLIP’s understanding of quantity from text, image, and cross-modal perspectives by carefully designing different experimental settings and datasets. |
| Outcome: | The proposed model has shown significant success in various downstream tasks, including editing, generation, and quality evaluation. |
Random Smooth-based Certified Defense against Text Adversarial Attack (2024.findings-eacl)
Copied to clipboard
| Challenge: | Textual adversarial examples train models on the worst-case text generated by substituting words in original texts with synonyms, but due to the discrete word embedding representations, the large search space hinders the robust training efficiency. |
| Approach: | They propose to treat the word substitution as a continuous perturbation on the word embedding representation and apply random smooth techniques to approximate the word replacement operation. |
| Outcome: | The proposed method outperforms conventional methods and improves the robustness in training. |
DRIFT: Transferring Reasoning Priors for Efficient MLLM Fine-Tuning (2026.findings-acl)
Copied to clipboard
Chao Huang, Zeliang Zhang, Jiang Liu, Ximeng Sun, Jialian Wu, Xiaodong Yu, Ze Wang, Chenliang Xu, Emad Barsoum, Zicheng Liu
| Challenge: | Multimodal large language models (MLLMs) have made rapid progress in perception and alignment, but their reasoning ability often lags behind strong text-only LLMs. |
| Approach: | They propose a method that transfers reasoning knowledge in the gradient space while preserving multimodal alignment. |
| Outcome: | Experiments on multimodal reasoning benchmarks show that DRIFT outperforms naive merging and standard SFT. |
Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have outstanding performance by learning a large number of model parameters on large amounts of data. |
| Approach: | They propose a method of grouping and pruning similar experts to improve the model’s parameter efficiency by a range of natural language tasks. |
| Outcome: | The proposed method outperforms other model pruning methods on a range of natural language tasks. |