Papers by Yujun Yan
GENUINE: Graph Enhanced Multi-level Uncertainty Estimation for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for estimation of uncertainty overlook semantic dependencies, authors say . genUINE: Graph ENhanced mUlti-level uncertainty Estimation for Large Language Models leverages dependency parse trees and hierarchical graph pooling . |
| Approach: | They propose a graph-enhanced mUlti-level uncertaINty estimation framework that leverages dependency parse trees and hierarchical graph pooling to refine uncertainty quantification. |
| Outcome: | The proposed framework achieves higher AUROC and lower calibration errors than existing methods. |
Representation Interventions Enable Lifelong Knowledge Memory Control in LLMs (2026.acl-long)
Copied to clipboard
Xuyuan Liu, Shengyu Chen, Xinshuai Dong, Yanchi Liu, Xujiang Zhao, Haoyu Wang, Yujun Yan, Haifeng Chen, Zhengzhang Chen
| Challenge: | Large language models (LLMs) produce outdated or inaccurate content. Updating their knowledge efficiently and accurately without costly retraining is a major challenge. |
| Approach: | They propose a robust and scalable method that treats knowledge control as interventions within the model’s representation space. |
| Outcome: | The proposed method achieves fine-grained control over complex, unstructured knowledge while maintaining general utility with frozen base weights. |
Spectral Insights into Data-Oblivious Critical Layers in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have identified critical layers linked to specific functions or behaviors, limiting their use to post-hoc settings. |
| Approach: | They propose a data-oblivious approach to identify intrinsic critical layers in pre-fine-tuned LLMs by analyzing representation dynamics via Centered Kernel Alignment. |
| Outcome: | The proposed approach identifies critical layers in pre-fine-tuned models . layers with significant shifts in representation space are also those most affected during fine-tuning . |
Judging with Many Minds: Do More Perspectives Mean Less Prejudice? On Bias Amplification and Resistance in Multi-Agent Based LLM-as-Judge (2025.findings-emnlp)
Copied to clipboard
Chiyu Ma, Enpei Zhang, Yilun Zhao, Wenjun Liu, Yaning Jia, Peijun Qing, Lin Shi, Arman Cohan, Yujun Yan, Soroush Vosoughi
| Challenge: | LLM-as-Judge frameworks provide scalable alternative to human evaluation . but the question of how intrinsic biases manifest in these settings remains unexplored . |
| Approach: | They conduct systematic analysis of four bias types in multi-agent LLM-as-Judge frameworks . they find debate framework amplifies biases sharply after initial debate . |
| Outcome: | The proposed frameworks amplify biases after debate and show they are stronger in meta-judge scenarios. |