Papers by Jiangyang He
TENP: Trapezoidal Expert Neuron Pruning For Mixture-of-Experts (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing compression approaches remove entire experts, disrupting routing topology and harming performance, or rely on unstructured weight pruning with limited practical efficiency. |
| Approach: | They propose a structured **T**rapezoidal **E**xpert **N**euron **P**running framework that uses a trapezoidal pattern to identify and retain important experts while applying expert neuron pruning (ENP) to less important experts. |
| Outcome: | The proposed framework outperforms the full-parameter model by 10% on code generation tasks under a sparse activation of experts and a 40% routing sparsity. |
SuLoRA: Subspace Low-Rank Adaptation for Parameter-Efficient Fine-Tuning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning large language models (LLMs) introduce parameter interference, leading to a gap in generalization performance for specific tasks compared to full fine-uning. |
| Approach: | They propose a parameter-separated low-rank adapter to account for task differences by decomposing LoRA’s parameter matrix into multiple independent subspaces and assigning them differentially to distinct tasks. |
| Outcome: | The proposed method outperforms LoRA in trainable parameter efficiency and overall model performance on various NLP tasks. |
Cultivating Gaming Sense for Yourself: Making VLMs Gaming Experts (2025.acl-long)
Copied to clipboard
| Challenge: | Recent efforts leverage Vision Language Models (VLMs) as direct controllers, often pausing the game to analyze screens and plan action through language reasoning. |
| Approach: | They propose a paradigm shift in gameplay agent design that uses Vision Language Models as a developer instead of direct control. |
| Outcome: | The proposed framework achieves fluent gameplay in diverse genres, including ACT, FPS, and Flappy Bird, setting a new benchmark for game-playing agents. |