Papers by Yanzhou Pan
ALinFiK: Learning to Approximate Linearized Future Influence Kernel for Scalable Third-Parity LLM Data Valuation (2025.naacl-long)
Copied to clipboard
Yanzhou Pan, Huawei Lin, Yide Ran, Jiamin Chen, Xiaodong Yu, Weijie Zhao, Denghui Zhang, Zhaozhuo Xu
| Challenge: | Large Language Models (LLMs) heavily rely on high-quality training data, making data valuation crucial for optimizing model performance. |
| Approach: | They propose a third-party data valuation approach that assesses the value of individual data samples and proposes a learning strategy to approximate LinFiK. |
| Outcome: | The proposed approach surpasses baselines in effectiveness and efficiency, showing significant scalability advantages as LLM parameters increase. |
Rescorla-Wagner Steering of LLMs for Undesired Behaviors over Disproportionate Inappropriate Context (2025.emnlp-main)
Copied to clipboard
Rushi Wang, Jiateng Liu, Cheng Qian, Yifan Shen, Yanzhou Pan, Zhaozhuo Xu, Ahmed Abbasi, Heng Ji, Denghui Zhang
| Challenge: | Incorporating external context can enhance the response quality of Large Language Models (LLMs). however, real-world contexts often mix relevant information with disproportionate inappropriate content. |
| Approach: | They propose a Poisoned Context Testbed to pair queries with real-world contexts . they propose 'rw-Steering' to internalize inappropriate signals . |
| Outcome: | The proposed model improves response quality by 39.8% and reverses undesirable behavior curve. |
ISACL: Internal State Analyzer for Copyrighted Training Data Leakage (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Traditional methods address leaks only after content is generated, which can lead to the exposure of sensitive information. |
| Approach: | They propose a proactive approach: examining LLMs’ internal states before text generation to detect potential leaks. |
| Outcome: | The proposed framework ensures adherence to copyright and licensing requirements while enhancing data privacy and ethical standards. |