Papers by Yuke Mei
LiveFact: A Dynamic, Time-Aware Benchmark for LLM-Driven Fake News Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Current evaluation frameworks are static and vulnerable to benchmark data contamination . current models are ineffective at assessing reasoning under temporal uncertainty . |
| Approach: | They propose a live-based benchmark that simulates the real-world "fog of war" they propose evaluating models on their ability to reason with evolving, incomplete information . |
| Outcome: | The proposed model outperforms proprietary state-of-the-art models in classification and evidence mode . it also provides a component to monitor BDC explicitly . |
SSA: Semantic Contamination of LLM-Driven Fake News Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Evaluating 45 variants of nine LLMs, we find LIAR2 accuracy climbs monotonically with injected contamination, while the SSA Factor escalates in near-perfect lock-step. |
| Approach: | They propose a framework that detects BDC risks across semantic to label level via entity shift perturbation and an interpretable metric, the SSA Factor. |
| Outcome: | The proposed framework detects BDC risks across semantic to label level via entity shift perturbation and interpretable metric, the SSA Factor. |
DCR: Quantifying Data Contamination in LLMs Evaluation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) memorize evaluation data during training, inflating performance metrics and undermining genuine generalization assessment. |
| Approach: | They propose a framework to detect and quantify benchmark data contamination (BDC) by synthesizing contamination scores via a fuzzy inference system. |
| Outcome: | The proposed framework detects and quantifies BDC risk across semantic, informational, data, and label levels. |