Papers by Xiaopeng Li
MTA:A Merge-then-Adapt Framework for Personalized Large Language Models (2026.acl-long)
Copied to clipboard
Xiaopeng Li, Yuanjin Zheng, Wanyu Wang, Wenlin Zhang, Pengyue Jia, Yingyi Zhang, Haiying He, Mengyang Ma, Yiqi Wang, Maolin Wang, Xuetao Wei, Xiangyu Zhao
| Challenge: | Personalized Large Language Models (PLLMs) aim to align outputs with individual user preferences . current methods of fine-tuning a separate module for each user are unscalable . |
| Approach: | They propose a Merge-then-Adapt framework for Personalized Large Language Models . they construct a shared Meta-LoRA bank and propose an Adaptive LoRA Fusion stage . |
| Outcome: | The proposed framework outperforms existing SOTA methods on the LaMP benchmark. |
A Static Evaluation of Code Completion by Large Language Models (2023.acl-industry)
Copied to clipboard
Hantian Ding, Varun Kumar, Yuchen Tian, Zijian Wang, Rob Kwiatkowski, Xiaopeng Li, Murali Krishna Ramanathan, Baishakhi Ray, Parminder Bhatia, Sudipta Sengupta
| Challenge: | Large language models trained on code have shown great potential to increase productivity of software developers. |
| Approach: | They propose a static evaluation framework to quantify static errors in Python code completions by leveraging Abstract Syntax Trees. |
| Outcome: | The proposed framework is more efficient and applicable to code in the wild. |
Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Pengyue Jia, Derong Xu, Xiaopeng Li, Zhaocheng Du, Xiangyang Li, Yichao Wang, Yuhao Wang, Qidong Liu, Maolin Wang, Huifeng Guo, Ruiming Tang, Xiangyu Zhao
| Challenge: | Existing approaches to rerank and align documents based on reasoning capabilities of large language models (LLMs) . prior work shows that LLMs have exceptional reasoning and text generation capabilities . |
| Approach: | They propose a rationale extraction method that leverages reasoning capabilities of large language models to extract the rationales necessary for answering a query. |
| Outcome: | The proposed method is compared with baseline methods on two tasks across three datasets. |
Humanity’s Last Code Exam: Can Advanced LLMs Conquer Human’s Hardest Code Competition? (2025.findings-emnlp)
Copied to clipboard
Xiangyang Li, Xiaopeng Li, Kuicai Dong, null Zhangquanhu, Rongju Ruan, Xinyi Dai, Yasheng Wang, Ruiming Tang
| Challenge: | o4-mini(high) and Gemini-2.5 Pro achieve pass@1 rates of only 15.9% and 11.4%, respectively. |
| Approach: | They propose a harmonized online–offline sandbox that guarantees fully reproducible evaluation. |
| Outcome: | The proposed test reflects the advanced reasoning and code generation ability of large language models. |
MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for query expansion lack corpus-specific knowledge and cost. |
| Approach: | They propose a query-query-document generation method that leverages large language models for mutual verification to produce diverse sub-queries and corresponding documents. |
| Outcome: | The proposed method is fully zero-shot and extensive experiments on three public benchmark datasets demonstrate its effectiveness over existing methods. |
Towards Explainable Chinese Native Learner Essay Fluency Assessment: Dataset, Tasks, and Method (2024.findings-emnlp)
Copied to clipboard
Xinshu Shen, Hongyi Wu, Yadong Zhang, Man Lan, Xiaopeng Bai, Shaoguang Mao, Yuanbin Wu, Xinlin Zhuang, Li Cai
| Challenge: | Existing GEC datasets in Chinese fail to consider specific grammatical error types and overlook cross-sentence grammamatical errors. |
| Approach: | They propose to use Chinese essay fluency assessment to assess essay fluencies along with coarse and fine-grained errors and corrections to improve explainability. |
| Outcome: | The proposed dataset encapsulates essay fluency scores along with both coarse and fine-grained errors and corrections. |
Don’t Miss the Potential Customers! Retrieving Similar Ads to Improve User Targeting (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a method for user targeting is developed to identify online users to whom an ad should be targeted. |
| Approach: | They propose a method for automatic augmentation of positive and negative clickthrough data for user targeting models. |
| Outcome: | The proposed method can increase positive and negative instances of positive training instances on two datasets. |
Modeling Personalization in Continuous Space for Response Generation via Augmented Wasserstein Autoencoders (D19-1)
Copied to clipboard
| Challenge: | Existing work on variableal autoencoders and waterstein autoencoding models has shown significant progress in open-domain response generation. |
| Approach: | They propose to embed user-level and utterance-level information into two multimodal distributions and combine them into a mixed distribution. |
| Outcome: | The proposed model outperforms state-of-the-art models on a large-scale real-world dataset. |
Exploring Continual Learning for Code Generation Models (2023.acl-short)
Copied to clipboard
Prateek Yadav, Qing Sun, Hantian Ding, Xiaopeng Li, Dejiao Zhang, Ming Tan, Parminder Bhatia, Xiaofei Ma, Ramesh Nallapati, Murali Krishna Ramanathan, Mohit Bansal, Bing Xiang
| Challenge: | Large-scale code generation models such as Copilot and CodeT5 are expensive to train and re-train. |
| Approach: | They propose a benchmark for Continual Learning (CL) that covers a wide range of tasks with different input and output programming languages. |
| Outcome: | The proposed method improves on Prompt Pooling with Teacher Forcing, which suffers catastrophic forgetting due to stark distribution shifts in coding tasks. |
Socratic Human Feedback (SoHF): Expert Steering Strategies for LLM Code Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly used for generating code solutions, but struggle with complex programming problems without human guidance. |
| Approach: | They use the “Socratic Feedback” paradigm to map observed feedback strategies to five stages of Socratic Questioning to identify failures in LLMs. |
| Outcome: | The proposed models solved 74% of the problems that the models initially failed to solve on their own. |
ContraCLM: Contrastive Learning For Causal Language Model (2023.acl-long)
Copied to clipboard
Nihal Jain, Dejiao Zhang, Wasi Uddin Ahmad, Zijian Wang, Feng Nan, Xiaopeng Li, Ming Tan, Ramesh Nallapati, Baishakhi Ray, Parminder Bhatia, Xiaofei Ma, Bing Xiang
| Challenge: | Existing studies show that causal language models lack expressiveness due to poor discrimination ability. |
| Approach: | They propose a contrastive learning framework that enhances discrimination of representations and bridges the gap with encoder-only models. |
| Outcome: | The proposed framework improves discrimination and source code generation capabilities on a variety of downstream tasks. |
Do not Abstain! Identify and Solve the Uncertainty (2025.acl-long)
Copied to clipboard
| Challenge: | Existing solutions rely on evasive responses when confronting uncertain scenarios. |
| Approach: | They propose a benchmark to assess LLMs' ability to recognize and address uncertainty . they generate context-aware inquiries that highlight the confusing aspect of the original query . |
| Outcome: | Experiments with ConfuseBench show that LLMs struggle to identify root cause of uncertainty and solve it. |
Stand on The Shoulders of Giants: Building JailExpert from Previous Attack Experience (2025.emnlp-main)
Copied to clipboard
Xi Wang, Songlei Jian, Shasha Li, Xiaopeng Li, Bin Ji, Ma Jun, Xiaodong Liu, Jing Wang, Jianfeng Zhang, Jie Yu, Feilong Bao, null Wangbaosheng
| Challenge: | Existing methods to generate human-aligned content with a “jailbreak prompt” are inefficient and repetitive, causing inefficiency and a lack of experience. |
| Approach: | They propose a framework that integrates past attack experiences to aid current jailbreak attempts. |
| Outcome: | The proposed framework improves both attack effectiveness and efficiency compared to the current black-box jailbreak method. |
Learning to Abstract for Memory-augmented Conversational Response Generation (P19-1)
Copied to clipboard
| Challenge: | Existing generative models for open-domain chit-chat conversations lack informativeness and diversity. |
| Approach: | They propose a retrieval-augmented generative model that learns to abstract from the training corpus and saves useful information to the memory to assist the response generation. |
| Outcome: | The proposed model outperforms other baselines in query-response clustering and learning to utilize these characteristics for response generation. |
JPU: Bridging Jailbreak Defense and Unlearning via On-Policy Path Rectification (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are vulnerable to diverse jailbreak attacks despite extensive safety alignment . |
| Approach: | They propose a method to rectify dynamic jailbreak paths towards safety anchors by dynamically mining on-policy adversarial samples to expose vulnerabilities and identify jailbreak path. |
| Outcome: | The proposed model significantly improves jailbreak resistance against dynamic attacks while maintaining its utility. |