Papers by Pengzhang Liu
LEGO-ABSA: A Prompt-based Task Assemblable Unified Generative Framework for Multi-task Aspect-based Sentiment Analysis (2022.coling-1)
Copied to clipboard
| Challenge: | Existing generative methods focus on a single task at a time. |
| Approach: | They propose a unified generative multi-task framework that can solve multiple ABSA tasks . they propose to control the type of task prompts consisting of multiple element prompts . |
| Outcome: | The proposed framework achieves state-of-the-art results in almost all ABSA tasks and competitive results in task transfer scenarios. |
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation (2025.acl-long)
Copied to clipboard
Guoqiang Gong, Jiaxing Wang, Jin Xu, Deping Xiang, Zicheng Zhang, Leqi Shen, Yifeng Zhang, JunhuaShu JunhuaShu, ZhaolongXing ZhaolongXing, Zhen Chen, Pengzhang Liu, Ke Zhang
| Challenge: | Knowledge distillation (KD) compresses large language models into lightweight versions called student models. |
| Approach: | They propose to align the entire feature dynamics between teacher and student models by using two additional loss terms to achieve this. |
| Outcome: | The proposed method matches the entire feature dynamics between teacher and student models rather than just the final states. |
GROLE: Instance-Level Group Relative Optimization for LoRA Experts in Incremental Learning (2026.findings-acl)
Copied to clipboard
Yongyi Liao, Wencan Lai, Jun Fang, Jinjin Guo, Xiaohui Zhang, Zhiyuan Liu, Chao Liu, Pengzhang Liu, Qixia Jiang
| Challenge: | Large language models demonstrate remarkable zero-shot generalization, but adapting to downstream tasks requires continual fine-tuning. |
| Approach: | They propose a method that incrementally constructs a pool of frozen, task-specific LoRA experts. |
| Outcome: | The proposed approach outperforms state-of-the-art methods in task-free and blurred-boundary settings. |