Papers by Yiwei Qin
SciPedia: Unlocking the Value of Scientific Data for Pre-training (2026.acl-long)
Copied to clipboard
| Challenge: | High-quality scientific data is critical for advancing LLMs, yet academic literature remains underutilized. |
| Approach: | They construct a large-scale raw scientific corpus but identify a critical Learnability Gap . they develop a multi-stage pipeline featuring content cleaning and pedagogical augmentation . |
| Outcome: | The proposed approach boosts average performance by +2.12 (3B) and +2.95 (7B) on in-domain tasks. |
InFoBench: Evaluating Instruction Following Ability in Large Language Models (2024.findings-acl)
Copied to clipboard
Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, Pengfei Liu, Dong Yu
| Challenge: | Existing methods for evaluating Large Language Models (LLMs) ability to follow instructions have not been able to provide a detailed analysis of their compliance with instructions. |
| Approach: | They propose a new metric for evaluating Large Language Models' ability to follow instructions and a benchmark for DRFR. |
| Outcome: | The proposed metric and benchmark compared with traditional scoring methods and explores annotation sources including human experts, crowd-sourced workers, and GPT-4. |
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for evaluating text quality are discriminative and generative . current methods use manual annotation of human judgements to train them . |
| Approach: | They propose a framework that combines the best of both worlds by using supervised and unsupervised signals from whatever data we have available. |
| Outcome: | The proposed method outperforms existing metrics on 5 datasets, 19 languages and 280 systems. |