Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Common NLP models are trained on data crawled from the internet, and it is difficult to audit at scale. |
| Approach: | They propose three strategies to prevent data contamination by encrypting test data and preventing it from being released on the internet. |
| Outcome: | The proposed strategies can make a difference in preventing data contamination. |
Similar Papers
Unveiling the Spectrum of Data Contamination in Language Model: A Survey from Detection to Remediation (2024.findings-acl)
Copied to clipboard
| Challenge: | Data contamination is a problem in Large language models due to the reliance on extensive internet-derived training corpora. |
| Approach: | They present a survey on the topic of data contamination in large language models. |
| Outcome: | The results of the first survey on data contamination in large language models provide a comprehensive guide for NLP researchers seeking a systematic understanding of the issue. |
AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledge (2025.acl-long)
Copied to clipboard
Xiaobao Wu, Liangming Pan, Yuxi Xie, Ruiwen Zhou, Shuai Zhao, Yubo Ma, Mingzhe Du, Rui Mao, Anh Tuan Luu, William Yang Wang
| Challenge: | Existing studies solve this challenge by updating benchmarks with newly collected data, but they fail to guarantee contamination-free evaluation as the newly collected knowledge may contain pre-existing knowledge. |
| Approach: | They propose an automated anti-leakage benchmarking framework that builds and updates benchmarks without human labor instead of using newly collected data. |
| Outcome: | The proposed framework significantly reduces the cost of benchmark maintenance to accommodate emerging LLMs. |
Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Considering the vast size and wide-ranging sources of LLMs’ training data, it could explicitly or implicitly include test data. |
| Approach: | They propose a Contamination Detection via output Distribution (CDD) which detects data contamination only by identifying the peakedness of LLM's output distribution. |
| Outcome: | The proposed method improves performance by 21.8%-30.2% on humanEval and TED: trustworthy evaluation via output distribution. |
Investigating Data Contamination in Modern Benchmarks for Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks for large language models are inflated and inconsistent with actual performance. |
| Approach: | They propose a retrieval-based system to explore potential overlaps between benchmarks and pretraining corpora and a protocol to investigate testset slot guessing. |
| Outcome: | The proposed method exploits overlaps between evaluation benchmarks and pretraining corpora and masks a wrong answer in a multiple choice question and prompts the model to fill in the gap. |
Benchmarking Large Language Models Under Data Contamination: A Survey from Static to Dynamic Evaluation (2025.emnlp-main)
Copied to clipboard
Simin Chen, Yiming Chen, Zexin Li, Yifan Jiang, Zhongwei Wan, Yixin He, Dezhi Ran, Tianle Gu, Haizhou Li, Tao Xie, Baishakhi Ray
| Challenge: | In the era of evaluating large language models, data contamination is an increasingly prominent concern . static benchmarking has been used for evaluation, but there are limitations of *dynamic* benchmarks . |
| Approach: | They propose a series of optimal design principles for *dynamic* benchmarking and analyze the limitations of existing *static* benchmarks. |
| Outcome: | The proposed benchmarks highlight a critical gap in the evaluation of LLMs. |
Towards Data Contamination Detection for Modern Large Language Models: Limitations, Inconsistencies, and Oracle Challenges (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for detecting data contamination in large language models have limitations and limitations . data contamination occurs when test or evaluation data is exposed to the model during its training phases . |
| Approach: | They evaluate five different methods for detecting data contamination in large language models . they find that current methods have non-trivial limitations in their assumptions and practical applications . |
| Outcome: | The proposed methods have non-trivial limitations and difficulties in detecting contamination . the authors highlight the complexity of contamination detection in advanced LLMs . |
Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs (2024.eacl-long)
Copied to clipboard
| Challenge: | Lack of access to model details has raised concerns about data contamination among researchers. |
| Approach: | They conduct the first systematic analysis of work using OpenAI’s GPT-3.5 and GPT-4, the most prominently used LLMs today, in the context of data contamination. |
| Outcome: | The proposed models have been exposed to 4.7M samples from 263 benchmarks during the first year after their release. |
An Open-Source Data Contamination Report for Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing contamination analysis is conducted internally by large language model developers and lacks transparency and completeness. |
| Approach: | They present a data contamination report for 15 popular large language models . they propose an open-source pipeline to perform contamination analysis on customised data . |
| Outcome: | The proposed pipeline enables the community to perform contamination analysis on customised data and models. |
NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for evaluating large language models using annotated benchmarks are in trouble . data contamination can cause wrong scientific conclusions being published . |
| Approach: | They argue that the evaluation of NLP tasks using annotated benchmarks is in trouble . they define different levels of data contamination and propose a community effort . |
| Outcome: | The proposed measures should detect when data from a benchmark was exposed to a model and flag papers with conclusions compromised by data contamination. |
When Benchmarks Leak: Inference-Time Decontamination for LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | a large number of large language models (LLMs) are being evaluated for their performance, but their reliability is threatened by test set contamination. |
| Approach: | They propose a framework that decontaminates large language models by applying small perturbations to the input embedding space. |
| Outcome: | The proposed framework achieves strong decontamination effectiveness while incurring minimal degradation in benign utility. |