Papers by Jiao Yueyang
CLEAN–EVAL: Clean Evaluation on Contaminated Large Language Models (2024.findings-naacl)
Copied to clipboard
Wenhong Zhu, Hongkun Hao, Zhiwei He, Yun-Ze Song, Jiao Yueyang, Yumeng Zhang, Hanxu Hu, Yiran Wei, Rui Wang, Hongyuan Lu
| Challenge: | Existing methods to evaluate large language models are prone to data contamination. |
| Approach: | They propose a method which parses contaminated data and back-translates it into a candidate set. |
| Outcome: | The proposed method reduces data contamination and evaluates the LLMs more cleanly. |
LNE-Blocking: An Efficient Framework for Contamination Mitigation Evaluation on Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a problem of data contamination is now almost inevitable during the development of large language models, with the training data often integrating evaluation benchmarks even unintentionally. |
| Approach: | They propose a framework to restore model performance prior to data contamination on potentially leaked datasets by using contamination detection and disruption operation. |
| Outcome: | The proposed framework restores model performance prior to contamination on potentially leaked datasets. |