Papers by Ying Chi
Meta-rater: A Multi-dimensional Data Selection Method for Pre-training Language Models (2025.acl-long)
Copied to clipboard
Xinlin Zhuang, Jiahui Peng, Ren Ma, Yinfan Wang, Tianyi Bai, Xingjian Wei, Qiu Jiantao, Chi Zhang, Ying Qian, Conghui He
| Challenge: | composition of pre-training datasets for large language models remains undisclosed . current methods for evaluating data quality are limited by single-dimensional evaluation or redundancy-focused strategies. |
| Approach: | They propose a multi-dimensional data selection method that integrates dimensions with existing quality metrics through learned optimal weightings. |
| Outcome: | The proposed method doubles convergence speed for 1.3B model models and improves downstream task performance by 3.23%. |
A Multi-Task Learning Framework for Extracting Bacteria Biotope Information (D19-57)
Copied to clipboard
| Challenge: | Existing methods to extract information from unstructured text are slow or expensive to get. |
| Approach: | They propose a multi-task transfer multi-learning method for Bacteria Biotope rel+ner task . they use BERT and pre-train it using mask language models and next sentence prediction . |
| Outcome: | The proposed method achieves the best performance on all metrics including slot error rate, precision and recall in the Bacteria Biotope rel+ner subtask. |
Spectral Characterization and Mitigation of Sequential Knowledge Editing Collapse (2026.acl-long)
Copied to clipboard
Chi Zhang, Mengqi Zhang, Xiaotian Ye, Runxi Cheng, Zisheng Zhou, Ying Zhou, Pengjie Ren, Zhumin Chen
| Challenge: | Existing approaches to reducing the effects of knowledge editing are insufficiently understood. |
| Approach: | They propose a plug-and-play framework that preserves the dominant subspace of the original weights and analyzes parameter updates in the spectral basis of the weights. |
| Outcome: | The proposed framework improves editing efficacy while preserving general abilities under long-horizon sequential editing, including extreme settings with up to 20,000 edits. |