Papers by Weixiang Zhao
CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation (2024.acl-long)
Copied to clipboard
Weixiang Yan, Haitian Liu, Yunkun Wang, Yunzhe Li, Qian Chen, Wen Wang, Tingyu Lin, Weishan Zhao, Li Zhu, Hari Sundaram, Shuiguang Deng
| Challenge: | Existing benchmarks for evaluating the code understanding and generation capacities of Large Language Models are insufficient . existing benchmarks focus on a narrow range of popular programming languages and specific tasks . |
| Approach: | They propose an execution-based, multilingual, multitask evaluation benchmark for LLMs . they evaluate coding performance from three dimensions: length, difficulty, efficiency . |
| Outcome: | The proposed benchmark covers 43 programming languages and eight coding tasks. |
CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding? (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have showcased impressive code generation capabilities, primarily evaluated through language-to-code benchmarks. |
| Approach: | They propose a benchmark to assess LLMs’ code understanding abilities from the perspective of code judging rather than code generation. |
| Outcome: | The proposed benchmark evaluates 12 well-known large language models to determine the correctness of provided code solutions. |
Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMs (2025.acl-long)
Copied to clipboard
Weixiang Zhao, Yulin Hu, Yang Deng, Jiahe Guo, Xingyu Sui, Xinyang Han, An Zhang, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu
| Challenge: | Existing role-play fine-tuning techniques improve role adaptability but may degrade safety performance, especially for villainous characters. |
| Approach: | They propose safety-aware Role-Play Fine-Tuning (SaRFT) to balance role-playing capabilities and safety. |
| Outcome: | The proposed method outperforms state-of-the-art baselines under both LoRA and full-parameter fine-tuning settings. |
On Safety Risks in Experience-Driven Self-Evolving Agents (2026.findings-acl)
Copied to clipboard
Weixiang Zhao, Yichen Zhang, Yingshuo Wang, Yang Deng, Yanyan Zhao, Xuda Zhi, Yongbo Huang, Hao He, Wanxiang Che, Bing Qin, Ting Liu
| Challenge: | Experience-driven self-evolution has emerged as a promising paradigm for improving the autonomy of large language model agents, yet its reliance on self-curated experience introduces underexplored safety risks. |
| Approach: | They investigate how experience accumulation and utilization in self-evolving agents affect safety performance across web-based and embodied environments. |
| Outcome: | The findings expose inherent limitations of current self-evolving agents and call for more principled strategies to ensure safe and reliable adaptation. |
MPO: Multilingual Safety Alignment via Reward Gap Optimization (2025.acl-long)
Copied to clipboard
Weixiang Zhao, Yulin Hu, Yang Deng, Tongtong Wu, Wenxuan Zhang, Jiahe Guo, An Zhang, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu
| Challenge: | Existing preference learning methods for safety alignment are monolingual and struggle with noisy multilingual data. |
| Approach: | They propose a multilingual reward gaP optimization approach that leverages the well-aligned safety capabilities of the dominant language to improve safety alignment across multiple languages. |
| Outcome: | Extensive experiments on three LLMs, LLaMA-3.1, Gemma-2 and Qwen2.5, validate MPO’s efficacy in multilingual safety alignment without degrading general multilingual utility. |
When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agents (2026.acl-long)
Copied to clipboard
Jiahe Guo, Xiangran Guo, Yulin Hu, Zimo Long, Xingyu Sui, Xuda Zhi, Yongbo Huang, Hao He, Weixiang Zhao, Yanyan Zhao, Bing Qin
| Challenge: | Existing research on personalized LLM agents focuses on the effectiveness of personalized responses. |
| Approach: | They propose a benchmark to quantify intent legitimation in personalized interactions . they propose 'detection-reflection' method that detects intent legititimation from internal representation space . |
| Outcome: | The proposed method reduces safety degradation by using internal representation space. |
Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence (2024.findings-acl)
Copied to clipboard
| Challenge: | Emotional Intelligence (EI) is a key concept in the field of human intelligence. |
| Approach: | They propose a method to enhance EI of large language models by naive fine-tuning on EI-related tasks. |
| Outcome: | The proposed method improves EI of two LLM-based assistants without compromising GI. |
MuCDN: Mutual Conversational Detachment Network for Emotion Recognition in Multi-Party Conversations (2022.coling-1)
Copied to clipboard
| Challenge: | Emotion recognition in multi-party conversations is a challenging task that predicts the emotion for each utterance. |
| Approach: | They propose to separate conversations into detached threads to capture emotional clues in conversational context . they propose to use mutual detachment networks to perform context and speaker-specific modeling within detached thread. |
| Outcome: | The proposed model outperforms baseline models on two datasets. |
Don’t Lose Yourself! Empathetic Response Generation via Explicit Self-Other Awareness (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing attempts to generate empathy with other-awareness ignore to include self-a awareness to consider the own views of the self in their responses. |
| Approach: | They propose to include self-awareness to consider the own views of the self in empathetic response generation by integrating three stages of self-other awareness into the process. |
| Outcome: | The proposed method is superior to existing methods on the benchmark dataset. |
Chain of Strategy Optimization Makes Large Language Models Better Emotional Supporter (2025.findings-emnlp)
Copied to clipboard
Weixiang Zhao, Xingyu Sui, Xinyang Han, Yang Deng, Yulin Hu, Jiahe Guo, Libo Qin, Qianyun Du, Shijin Wang, Yanyan Zhao, Bing Qin, Ting Liu
| Challenge: | Existing supervised fine-tuning (SFT) fails to address these issues, as it trains models on single gold-standard responses without modeling nuanced strategy trade-offs. |
| Approach: | They propose a two-stage framework that optimizes strategy selection preferences at each dialogue turn. |
| Outcome: | The proposed framework improves strategy selection preferences at each dialogue turn. |
ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing research treats memory as a mechanism for factual retention, neglecting its role in shaping users’ emotional experiences. |
| Approach: | They propose a benchmark for evaluating Emotional Need-aware Proactive Memory Retrieval (ENPMR) it enables agents to infer users’ latent emotional needs and proactively retrieve appropriate memories to support empathetic interaction. |
| Outcome: | The proposed benchmark includes over 1,800 memory-augmented dialogues and defines structured mappings between emotional needs and supportive memory types. |
AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender (2025.emnlp-main)
Copied to clipboard
Weixiang Zhao, Jiahe Guo, Yulin Hu, Yang Deng, An Zhang, Xingyu Sui, Xinyang Han, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu
| Challenge: | Activation steering offers training-free defense but relies on fixed steering coefficients, resulting in suboptimal protection and increased false rejections of benign inputs. |
| Approach: | They propose an adaptive activation steering method that dynamically adjusts model behavior based on input characteristics. |
| Outcome: | The proposed method outperforms baseline methods across multiple jailbreak attacks with minimal impact on utility. |
TransESC: Smoothing Emotional Support Conversation via Turn-Level State Transition (2023.findings-acl)
Copied to clipboard
| Challenge: | Emotion Support Conversation (ESC) is a goaldirected task with the goal of reducing the emotional distress of people. |
| Approach: | They propose to take turn-level state Transitions of ESC from three perspectives to generate smooth transitions between utterances. |
| Outcome: | The proposed method generates smoother and more effective responses on automatic and human evaluations. |
TEA-Bench: A Systematic Benchmarking of Tool-enhanced Emotional Support Dialogue Agent (2026.acl-long)
Copied to clipboard
| Challenge: | Existing ESC systems focus on affective support in text-only settings, ignoring how external tools can enable factual grounding and reduce hallucination in multi-turn emotional support. |
| Approach: | They propose a benchmark for evaluating tool-augmented agents in ESC with realistic emotional scenarios and an MCP-style tool environment. |
| Outcome: | The proposed benchmarks show that tool augmentation improves emotional support quality and reduces hallucination, but weaker models benefit only marginally. |
SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models (2024.acl-long)
Copied to clipboard
Weixiang Zhao, Shilong Wang, Yulin Hu, Yanyan Zhao, Bing Qin, Xuanyu Zhang, Qing Yang, Dongliang Xu, Wanxiang Che
| Challenge: | Existing methods to address catastrophic forgetting and knowledge transfer in large language models (LLMs) ignore potential of aligning the two modules to effectively address catastrophic forgetting and knowledge transfers simultaneously. |
| Approach: | They propose a Shared Attentive Learning & Selection module to align the PET learning and selection modules to address catastrophic forgetting and knowledge transfer simultaneously. |
| Outcome: | Experiments on two CL benchmarks show that the proposed framework is superior when scaled to different model sizes, different model architectures and unseen tasks. |