Papers by Han Yue

No Black Boxes: Interpretable and Interactable Predictive Healthcare with Knowledge-Enhanced Agentic Causal Discovery (2025.findings-emnlp)

Challenge:	Existing frameworks for Augmented Language Models lack flexibility, democratization, and holistic evaluation.
Approach:	They propose a lightweight and extensible framework for Augmented Language Models called Gentopia.
Outcome:	The proposed framework integrates language models, task formats, prompting modules, and plugins into a unified paradigm.

Copied to clipboard

Xiaoxue Han, Pengfei Hu, Chang Lu, Jun-En Ding, Feng Liu, Yue Ning

Direct Value Optimization: Improving Chain-of-Thought Reasoning in LLMs with Refined Values (2025.emnlp-main)

Challenge:	Deep learning models lacking interpretability and interactivity, authors say . lack of interactive mechanisms prevents clinicians from incorporating their own knowledge into decision-making process.
Approach:	a new deep learning model is proposed to improve interpretability and interactivity . authors propose a knowledge-enhanced agent-driven causal discovery framework .
Outcome:	a new model improves interpretability and interactivity on EHR data . the proposed model improve interpretability through explicit reasoning and causal analysis .

Copied to clipboard

Hongbo Zhang, Han Cui, Guangsheng Bao, Linyi Yang, Jun Wang, Yue Zhang

Reasoning

Challenge:	Existing offline preference optimization methods rely on preference labels to optimize large language models.
Approach:	They propose an offline method for enhancing large language models in reasoning tasks that utilizes value signals at individual reasoning steps.
Outcome:	The proposed framework outperforms offline preference optimization techniques by 4% to 6% on math reasoning, commonsense reasoning, and coding tasks.

PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning (2026.acl-long)

Copied to clipboard

Jingcheng Hu, Yinmin Zhang, Shijie Shang, Xiaobo Yang, Yue Peng, Zhewei Huang, Hebin Zhou, Xin Wu, Jie Cheng, Fanqi Wan, Xiangwen Kong, Chengyuan Yao, Kaiwen Yan, Ailin Huang, Hongyu Zhou, Qi Han, Zheng Ge, Xiangyu Zhang, Heung-Yeung Shum

Reasoning

Challenge:	Parallel Coordinated Reasoning (PaCoRe) overcomes a central limitation of contemporary language models: their inability to scale test-time compute (TTC) far beyond sequential reasoning under a fixed context window.
Approach:	They propose a training-and-inference framework to overcome a central limitation of language models: their inability to scale test-time compute (TTC) under a fixed context window.
Outcome:	The proposed model scales to multi-million-token effective TTC without exceeding context limits.

CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation Backdoor (2025.emnlp-main)

Copied to clipboard

Zhenhua Xu, Xixiang Zhao, Xubin Yue, Shengwei Tian, Changting Lin, Meng Han

Robustness in NLP

Challenge:	Existing methods for fingerprinting model ownership traces are vulnerable to illegal plagiarism and are not reliable.
Approach:	They propose a rule-driven fingerprinting framework that encodes contextual correlations across multiple dialogue turns.
Outcome:	The proposed framework achieves stronger stealth and robustness than previous work.

DIDS: Domain Impact-aware Data Sampling for Large Language Model Training (2025.emnlp-main)

Copied to clipboard

Weijie Shi, Jipeng Zhang, Yaguang Wu, Jingzhi Fang, Shibo Zhang, Yao Zhao, Hao Chen, Ruiyuan Zhang, Yue Cui, Jia Zhu, Sirui Han, Jiajie Xu, Xiaofang Zhou

Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models (2025.findings-acl)

Challenge:	Existing approaches for optimizing domain-level sampling strategies struggle with maintaining intra-domain consistency and accurately measuring domain impact.
Approach:	They propose to use a Fisher-Information Matrix-guided metric to measure domain impact to ensure intra-domain consistency and accuracy.
Outcome:	The proposed model achieves 3.4% higher average performance while maintaining comparable training efficiency.

Copied to clipboard

Yingqian Cui, Pengfei He, Jingying Zeng, Hui Liu, Xianfeng Tang, Zhenwei Dai, Yan Han, Chen Luo, Jing Huang, Zhen Li, Suhang Wang, Yue Xing, Jiliang Tang, Qi He

RECALL: REpresentation-aligned Catastrophic-forgetting ALLeviation via Hierarchical Model Merging (2025.emnlp-main)

Challenge:	Chain-of-Thought (CoT) reasoning has improved the performance of large language models (LLMs) however, the detailed reasoning process in CoT often incurs long generation times and high computational costs due to the inclusion of unnecessary steps.
Approach:	They propose a method to identify critical reasoning steps using perplexity as a measure of their importance.
Outcome:	The proposed method achieves a better balance between reasoning accuracy and efficiency of CoT.

Copied to clipboard

Bowen Wang, Haiyuan Wan, Liwen Shi, Chen Yang, Peng He, Yue Ma, Haochen Han, Wenhao Li, Tiao Tan, Yongjian Li, Fangming Liu, Gong Yifan, Sheng Zhang

Multi-Hop Open-Domain Question Answering over Structured and Unstructured Knowledge (2022.findings-naacl)

Challenge:	Existing models that require task labels or performance trade-offs are susceptible to catastrophic forgetting.
Approach:	They propose a representation-aware model merging framework for continual learning without access to historical data.
Outcome:	The proposed framework outperforms baselines in knowledge retention and generalization across five NLP tasks and multiple continual learning scenarios.

Copied to clipboard

Yue Feng, Zhen Han, Mingming Sun, Ping Li

Structured Data in NLP

Challenge:	Existing open-domain question answering systems only select one source to generate answer or conduct reasoning on structured information.
Approach:	They propose a Document-Entity Heterogeneous Graph Network to integrate different sources of information and conduct reasoning on heterogeneous information.
Outcome:	The proposed model outperforms the state-of-the-art methods on a HybirdQA dataset.

Quantifying the Impact of Structured Output Format on Large Language Models through Causal Inference (2026.findings-eacl)

Copied to clipboard

Han Yuan, Yue Zhao, Li Zhang, Wuqiong Luo, Zheng Ma

Learning While Staying Curious: Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning Models (2026.acl-long)

Challenge:	Prior studies have examined the impact of structured output on LLMs’ generation quality, often presenting one-way findings.
Approach:	They propose to derive five potential causal structures characterizing the influence of structured output on LLMs’ generation using one assumed and two guaranteed constraints.
Outcome:	The proposed pipeline can be extended to other modules and is not limited to structured output but can be used in industrial applications.

Copied to clipboard

Hao Wang, Hao Gu, Hongming Piao, Kaixiong Gong, Yuxiao Ye, Xiangyu Yue, Sirui Han, Yike Guo, Dapeng Wu

Exploring Memorization in Fine-tuned Language Models (2024.acl-long)

Challenge:	Recent advances establish "SFT-then-RL" as the defacto paradigm for enhancing large reasoning mod- els on automatically verifiable tasks.
Approach:	They propose an entropy-preserving SFT method to enhance exploration capabilities through intrinsic curiosity.
Outcome:	The proposed method outperforms the vanilla method on reasoning tasks by 2.5 points . it also outperformed the vanilla SFT by 2.9 points on out-of-distribution tasks .

Copied to clipboard

Shenglai Zeng, Yaxin Li, Jie Ren, Yiding Liu, Han Xu, Pengfei He, Yue Xing, Shuaiqiang Wang, Jiliang Tang, Dawei Yin

Praetor: A Fine-Grained Generative LLM Evaluator with Instance-Level Customizable Evaluation Criteria (2025.acl-long)

Challenge:	Existing studies have shown that pre-trained langauge models tend to memorize and regenerate segments of their pre-training corpus when prompted appropriately.
Approach:	They conduct the first comprehensive analysis to explore language models’ memorization during fine-tuning across tasks.
Outcome:	The proposed analysis shows that memorization presents a strong disparity among different fine-tuning tasks.

Copied to clipboard

Yongqi Leng, Renren Jin, Yue Chen, Zhuowen Han, Ling Shi, Jianxiang Peng, Lei Yang, Juesi Xiao, Deyi Xiong

Challenge:	Existing evaluation methods are inadequate to evaluate large language models (LLMs).
Approach:	They propose a fine-grained generative LLM evaluator with instance-level customazable evaluation criteria that can be used to evaluate large language models.
Outcome:	The proposed model outperforms existing LLM evaluators and instruction-tuned LLMs on multiple benchmarks and sets new SOTA results.

The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG) (2024.findings-acl)

Copied to clipboard

Shenglai Zeng, Jiankun Zhang, Pengfei He, Yiding Liu, Yue Xing, Han Xu, Jie Ren, Yi Chang, Shuaiqiang Wang, Dawei Yin, Jiliang Tang

Probing Audio-Visual Reasoning in Multimodal Language Models through the Lens of Audio (2026.acl-long)

Challenge:	Retrieval-augmented generation (RAG) is a powerful technique to facilitate language model generation with proprietary and private data, where data privacy is . a privacy issue that is currently under-explored, is posed by RAG.
Approach:	They propose to use retrieval-augmented generation (RAG) to facilitate language model generation with proprietary and private data where data privacy is a pivotal concern.
Outcome:	The proposed attack methods demonstrate that RAG can mitigate the old risks, i.e., leakage of the LLMs’ training data.

Copied to clipboard

Kaixiong Gong, Kaituo Feng, Bohao Li, Yibing Wang, Mofan Cheng, Shijia Yang, Jiaming Han, Benyou Wang, Yutong Bai, Zhuoran Yang, Xiangyu Yue

Multimodality

Challenge:	Recent multimodal large language models lack robust audio-visual integration ability and performance on DeafTest is highly correlated with AV-Odyssey accuracy.
Approach:	They propose a benchmarking tool that integrates audio-visual reasoning with audio-video cues to infer solutions.
Outcome:	The proposed model performs well on DeafTest, but lacks audio perception in simple audio tasks.

COPR: Continual Human Preference Learning via Optimal Policy Regularization (2025.findings-acl)

Copied to clipboard

Han Zhang, Lin Gui, Yu Lei, Yuanzhao Zhai, Yehong Zhang, Zhuo Zhang, Yulan He, Hui Wang, Yue Yu, Kam-Fai Wong, Bin Liang, Ruifeng Xu

From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)

Challenge:	Reinforcement Learning from Human Feedback (RLHF) is effective for aligning Large Language Models with human preferences, but its complex process limits its ability to continually learn human feedback.
Approach:	They propose a non-RL offline method to convert historical optimal policies into optimization constraints when continually learning new preferences.
Outcome:	The proposed method outperforms strong CL baselines in terms of reward-based evaluations and human assessment.

Copied to clipboard

Lei Yang, Leiyu Pan, Bojian Xiong, Renren Jin, Shaowei Zhang, Yue Chen, Ling Shi, Jiang Zhou, Junru Wu, Zhen Wang, Jianxiang Peng, Juesi Xiao, Tianyu Dong, Zhuowen Han, Zhuo Chen, Yuqi Ren, Deyi Xiong

Data Poisoning for In-context Learning (2025.findings-naacl)

Challenge:	Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages.
Approach:	They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English.
Outcome:	The proposed model outperforms open-source and Tibetan-focused models on diverse tasks.

Copied to clipboard

Pengfei He, Han Xu, Yue Xing, Hui Liu, Makoto Yamada, Jiliang Tang

Guardian-as-an-Advisor: Advancing Next-Generation Guardian Models for Trustworthy LLMs (2026.findings-acl)

Challenge:	In-context learning (ICL) has emerged as a capability of large language models (LLMs) but there is limited understanding of its vulnerability against data poisoning attacks.
Approach:	They propose an attack method that exploits ICL’s unique learning mechanisms by identifying discrete text perturbations that influence LLM hidden states.
Outcome:	The proposed attack method exploits ICL’s learning mechanisms by identifying discrete text perturbations that influence LLM hidden states.

Copied to clipboard

Yue Huang, Haomin Zhuang, Jiayi Ye, Han Bao, Yanbo Wang, Hang Hua, Siyuan Wu, Pin-Yu Chen, Xiangliang Zhang

Diagnosing Hidden Instabilities in Model Editing via Uncertainty Quantification (2026.acl-long)

Challenge:	prevailing taxonomies neglect robustness and honesty, yielding safer-on-paper but less useful systems.
Approach:	They propose a soft-gating pipeline where a guardian predicts a binary risk label plus a concise explanation and prepends this advice to the original query for re-inference.
Outcome:	The proposed model maintains safety while reducing over-refusal.

Copied to clipboard

Zihan Gu, TianYi Zhang, Xinyan Zhang, Zhiyuan Wang, Han Zhang, Yuhao Wei, Jiacheng Lu, Tianyi Ma, Xingsheng Zhang, Hua Zhang, Yue Hu

Challenge:	Existing methods to update large language models (LLMs) without expensive retraining are fragile under single-edit evaluation protocols.
Approach:	They propose a framework that characterizes activation-based editing as a constrained intervention on intermediate representations.
Outcome:	The proposed method reveals local knowledge conflicts invisible to existing benchmarks.

Multilingual Sentence Transformer as A Multilingual Word Aligner (2022.findings-emnlp)

Copied to clipboard

Weikang Wang, Guanhua Chen, Hanqing Wang, Yue Han, Yun Chen

PhiloGPT: A Philology-Oriented Large Language Model for Ancient Chinese Manuscripts with Dunhuang as Case Study (2024.emnlp-main)

Challenge:	Multilingual pretrained language models (mPLMs) have shown their effectiveness in multilingual word alignment induction, but these methods usually start from mBERT or XLM-R.
Approach:	They propose to fine tune multilingual sentence Transformer LaBSE for alignment induction using parallel corpus and a parallel corpora model.
Outcome:	The proposed model outperforms existing models on seven language pairs and achieves new state-of-the-art on zero-shot language pairs.

Copied to clipboard

Yuqing Zhang, Baoyi He, Yihan Chen, Hangqi Li, Han Yue, Shengyu Zhang, Huaiyong Dou, Junchi Yan, Zemin Liu, Yongquan Zhang, Fei Wu

DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)

Challenge:	philology requires years of professional training in extensive knowledge memorization and manual textual retrieval.
Approach:	They curated the PhiloCorpus-ZH, a rich collec-tion of ancient Chinese texts spanning a millennium with 30 diverse topics, including firsthand folk copies.
Outcome:	The PhiloCorpus-ZH corpus facilitated the development of the first LLM tailored for discovering ancient Chinese manuscripts.

Copied to clipboard

Yue Chen, Yifei Sun, Lu Wang, Fangkai Yang, Pu Zhao, Minjie Hong, Yifei Dong, Minghua He, Nan Hu, Jianjin Zhang, Zhiwei Dai, Yuefeng Zhan, Weihao Han, Hao Sun, Qingwei Lin, Weiwei Deng, Feng Sun, Qi Zhang, Saravan Rajmohan, Dongmei Zhang

Challenge:	Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability.
Approach:	They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence.
Outcome:	The proposed model outperforms baselines on three real-world datasets.

PolicyLLM: Towards Excellent Comprehension of Public Policy for Large Language Models (2026.findings-acl)

Copied to clipboard

Han Bao, Penghao Zhang, Yue Huang, Zhengqing Yuan, Yanchi Ru, SU Rui, Yujun Zhou, Xiangqi Wang, Kehan Guo, Nitesh V Chawla, Yanfang Ye, Xiangliang Zhang

Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (2024.emnlp-main)

Challenge:	Large Language Models (LLMs) are increasingly integrated into real-world decision-making, but their ability to comprehend and reason about policy-related content remains underexplored.
Approach:	They propose a bilingual benchmark evaluating policy comprehension comprising 21K cases across a broad spectrum of policy areas.
Outcome:	The proposed model shows stronger performance on application-oriented policy tasks than on memorization or conceptual understanding, and yields the highest accuracy on structured reasoning tasks.

Copied to clipboard

Yuping Lin, Pengfei He, Han Xu, Yue Xing, Makoto Yamada, Hui Liu, Jiliang Tang

PREE: Towards Harmless and Adaptive Fingerprint Editing in Large Language Models via Knowledge Prefix Enhancement (2025.findings-emnlp)

Challenge:	Large language models (LLMs) are susceptible to a type of attack known as jailbreaking, which misleads LLMs to output harmful contents.
Approach:	They propose to leverage hidden representations into existing jailbreak targets to move the attacks along the acceptance direction.
Outcome:	The proposed methods are validated using the objective of existing jailbreak attacks.

Copied to clipboard

Xubin Yue, Zhenhua Xu, Wenpeng Xing, Jiahui Yu, Mohan Li, Meng Han

Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study (2025.findings-emnlp)

Challenge:	Existing black-box fingerprinting techniques rely on overfitting high-perplexity trigger patterns . experimental results show that model editing in the fingerprint domain exhibits unique advantages .
Approach:	They propose a prefix-enhanced fingerprint editing framework that encodes copyright information into parameter offsets through dual-channel knowledge edit to achieve covert embedding of fingerprint features.
Outcome:	The proposed model editing framework achieves 90% trigger precision in mainstream architectures . the proposed model editor achieves the 90% accuracy in mainstream models .

Copied to clipboard

Yujun Zhou, Jiayi Ye, Zipeng Ling, Yufei Han, Yue Huang, Haomin Zhuang, Zhenwen Liang, Kehan Guo, Taicheng Guo, Xiangqi Wang, Xiangliang Zhang

Mitigating the Privacy Issues in Retrieval-Augmented Generation (RAG) via Pure Synthetic Data (2025.emnlp-main)

Challenge:	Existing benchmarks that rely on final-answer accuracy fail to capture the quality of the reasoning process.
Approach:	They propose a fine-grained evaluation framework that assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing.
Outcome:	The proposed framework assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing.

Copied to clipboard

Shenglai Zeng, Jiankun Zhang, Pengfei He, Jie Ren, Tianqi Zheng, Hanqing Lu, Han Xu, Hui Liu, Yue Xing, Jiliang Tang

Entity Resolution in Open-domain Conversations (2021.naacl-industry)

Challenge:	Existing literature suggests that RAG systems may face privacy issues when the retrieval process involves private data.
Approach:	They propose a two-stage synthetic data generation paradigm that uses attributes to preserve contextual information from the original data.
Outcome:	The proposed approach preserves key contextual information from the original data while reducing privacy risks.

Copied to clipboard

Mingyue Shang, Tong Wang, Mihail Eric, Jiangning Chen, Jiyang Wang, Matthew Welch, Tiantong Deng, Akshay Grewal, Han Wang, Yue Liu, Yang Liu, Dilek Hakkani-Tur

Natural Language Interfaces

Challenge:	Recent work on incorporating external knowledge into the response generation models has attracted great interest.
Approach:	They propose a neural entity linking approach to incorporate external knowledge into the response generation models to improve the relevancy of retrieved knowledge.
Outcome:	The proposed approach outperforms the baseline model by 62.8% relative to the baseline.

Optimizing NLU Reranking Using Entity Resolution Signals in Multi-domain Dialog Systems (2021.naacl-industry)

Copied to clipboard

Tong Wang, Jiangning Chen, Mohsen Malmir, Shuyan Dong, Xin He, Han Wang, Chengwei Su, Yue Liu, Yang Liu

Dialogue Systems & Conversational Agents

Challenge:	In dialog systems, the Natural Language Understanding component makes the interpretation decision before the mentioned entities are resolved.
Approach:	They propose to leverage Entity Resolution (ER) features in NLU reranking to learn model weights . they propose a score distribution matching method to ensure the models are calibrated .
Outcome:	The proposed approach outperforms the baseline model on multiple domain evaluations.

Enhancing Generalization in Natural Language Inference by Syntax (2020.findings-emnlp)

Copied to clipboard

Qi He, Han Wang, Yue Zhang

InterIDEAS: Philosophical Intertextuality via LLMs (2025.emnlp-main)

Challenge:	Pre-trained language models such as BERT have the state-of-the-art performance on natural language inference (NLI).
Approach:	They propose to use dependency trees to enhance generalization of BERT in a natural language inference task by leveraging on a graph convolutional network to represent a syntax-based matching graph with heterogeneous matching patterns.
Outcome:	The proposed method makes BERT more robust on syntactic changes.

Copied to clipboard

Yue Yang, Yinzhi Xu, Chenghao Huang, JohnMichael Jurgensen, Han Hu, Hao Wang

Challenge:	a new dataset aims to bridge philosophy, literary studies, and natural language processing (NLP) by integrating theories of intertextuality with bibliometric techniques.
Approach:	They propose a dataset that bridges philosophy, literary studies, and natural language processing (NLP) it combines theories of intertextuality from literary studies with bibliometric techniques and recent LLMs .
Outcome:	a new dataset bridges philosophy, literary studies, and natural language processing (NLP) to analyze intertextuality . the proposed method helps scholars understand the intellectual, social, and historical relations embedded in texts . it also contributes to the development of language models, authors say .

SafeScientist: Enhancing AI Scientist Safety for Risk-Aware Scientific Discovery (2025.emnlp-main)

Copied to clipboard

Kunlun Zhu, Jiaxun Zhang, Ziheng Qi, Nuoxing Shang, Zijia Liu, Peixuan Han, Yue Su, Haofei Yu, Jiaxuan You

SOLAR-RL: Semi-Online Long-horizon Assignment Reinforcement Learning (2026.findings-acl)

Challenge:	Recent advances in large language model (LLM) agents have significantly accelerated scientific discovery automation, yet raised critical ethical and safety concerns.
Approach:	They propose a framework to enhance safety and ethical responsibility in AI-driven scientific exploration.
Outcome:	The proposed framework significantly improves safety performance by 35% compared to traditional frameworks.

Copied to clipboard

Jichao Wang, Liuyang Bian, Yufeng Zhou, Han Xiao, Yue Pan, Guozhi Wang, Hao Wang, Zhaoxiong Wang, Yafei Wen, Xiaoxin Chen, Shuai Ren, Lingfang Zeng