Papers by Jinbin Zhang
UER: An Open-Source Toolkit for Pre-training Models (D19-3)
Copied to clipboard
Zhe Zhao, Hui Chen, Jinbin Zhang, Xin Zhao, Tao Liu, Wei Lu, Xi Chen, Haotang Deng, Qi Ju, Xiaoyong Du
| Challenge: | Existing work on pre-training models have shown that it is important to use a framework to deploy various pre- training models efficiently. |
| Approach: | They propose an assemble-on-demand pre-training toolkit that assembles pre-trained models on demand and encapsulates them with rich modules. |
| Outcome: | The proposed framework can reproduce state-of-the-art models or develop models that remain unexplored. |
Large Language Model as a Teacher for Zero-shot Tagging at Extreme Scales (2025.coling-main)
Copied to clipboard
| Challenge: | Extreme Zero-shot XMC uses lightweight bi-encoders to identify pseudo labels . state-of-the-art methods rely on suboptimal labels for training . |
| Approach: | They propose a framework that uses a lightweight bi-encoder to identify high-quality pseudo labels during training while employing a lightweight bi-coder for efficient inference. |
| Outcome: | The proposed framework achieves superior performance and efficiency over existing methods. |