Papers by Ningyuan Yang
Logic Matters in Lightweight Hallucination Classification for RAG System (2026.acl-long)
Copied to clipboard
| Challenge: | Existing hallucination detection frameworks for RAGs lack robustness and performance . a compact model may lose track of precise information in retrieved segments or misinterpret a document's entailment score. |
| Approach: | They propose a lightweight, modular framework for hallucination detection in RAG systems . they capture logical relationships among retrieved documents within the vector space . |
| Outcome: | The proposed framework improves hallucination detection in RAG systems without complex architectures or pre-training on datasets. |
Revealing the Numeracy Gap: An Empirical Investigation of Text Embedding Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Text embedding models are widely used in natural language processing but are often benchmarked on tasks that do not require understanding nuanced numerical information in text. |
| Approach: | They evaluate 13 widely used text embedding models and find they struggle to capture numerical details accurately. |
| Outcome: | The proposed models struggle to capture nuanced numerical details accurately, despite being benchmarked on tasks that do not require understanding nuance. |
ReLearn: Unlearning via Learning for Large Language Models (2025.acl-long)
Copied to clipboard
Haoming Xu, Ningyuan Zhao, Liming Yang, Sendong Zhao, Shumin Deng, Mengru Wang, Bryan Hooi, Nay Oo, Huajun Chen, Ningyu Zhang
| Challenge: | Existing methods for unlearning large language models often rely on reverse optimization to reduce target token probabilities. |
| Approach: | They propose a data augmentation and fine-tuning pipeline for effective unlearning . they propose augmentation, evaluation frameworks to measure contextual forgetting . |
| Outcome: | The proposed framework achieves targeted forgetting while preserving high-quality outputs. |
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching (2022.findings-naacl)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Zhe Zhao, Qi Ju, Xuefeng Yang, Rong Tian, Zhu Tao, Haoyan Liu, Han Guo, Xingyu Bai, Weiquan Mao, Yudong Li, Weigang Guo, Taiqiang Wu, Ningyuan Sun
| Challenge: | Existing studies have shown that cross-lingual knowledge distillation can improve the performance of pre-trained models for cross-linguistic similarity matching tasks. |
| Approach: | They propose a multi-stage distillation framework for constructing a small-size but high-performance cross-lingual model using contrastive learning, bottleneck, and parameter recurrent strategies. |
| Outcome: | The proposed model can compress the size of XLM-R and MiniLM by more than 50% while the performance is only reduced by about 1%. |
RACC: Regret-Aware Confidence Calibration for Consistent Masked Discrete Diffusion Decoding (2026.findings-acl)
Copied to clipboard
| Challenge: | Masked Discrete Diffusion Models (MDMs) enable parallel generation via iterative refinement, but their current decoding paradigms are static and myopic. |
| Approach: | They propose a Regret-Aware Confidence Calibration framework that aligns decoding decisions with the model’s latent self-correction capabilities. |
| Outcome: | The proposed framework aligns decoding decisions with model’s latent self-correction capabilities. |