Papers by Panpan Xu
A Systematic Survey of Automatic Prompt Optimization Techniques (2025.emnlp-main)
Copied to clipboard
Kiran Ramnath, Kang Zhou, Sheng Guan, Soumya Smruti Mishra, Xuan Qi, Zhengyuan Shen, Shuai Wang, Sangmin Woo, Sullam Jeoung, Yawei Wang, Haozhu Wang, Han Ding, Yuzhe Lu, Zhichao Xu, Yun Zhou, Balasubramaniam Srinivasan, Qiaojing Yan, Yueyan Chen, Haibo Ding, Panpan Xu, Lin Lee Cheong
| Challenge: | Recent advances in prompt engineering have created impediments for end users to adopt . however, prompt engineering remains an impedance due to rapid advances in models, tasks, and associated best practices. |
| Approach: | They propose to define APO as a 5-part unifying framework and categorize all relevant works based on their salient features. |
| Outcome: | The proposed framework aims to improve the performance of large language models on various tasks. |
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models (2024.acl-long)
Copied to clipboard
Damai Dai, Chengqi Deng, Chenggang Zhao, R.x. Xu, Huazuo Gao, Deli Chen, Jiashi Li, Wangding Zeng, Xingkai Yu, Y. Wu, Zhenda Xie, Y.k. Li, Panpan Huang, Fuli Luo, Chong Ruan, Zhifang Sui, Wenfeng Liang
| Challenge: | Mixture-of-Experts (MoE) architectures face challenges in ensuring expert specialization . despite the promising performance, scaling language models to an extremely large scale is associated with exceedingly high computational costs. |
| Approach: | They propose an architecture that allows for ultimate expert specialization by segmenting experts into mN ones and activating mK from them. |
| Outcome: | The proposed architecture achieves comparable performance with GShard with 2B parameters and computation. |
SALT: Step-level Advantage Assignment for Long-horizon Agents via Trajectory Graph (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities, but their application to complex, multi-step, and long-horizon tasks remains challenging. |
| Approach: | They propose a framework that provides a finer-grained advantage assignment derived solely from outcome rewards. |
| Outcome: | The proposed framework provides a finer-grained advantage assignment, derived solely from outcome rewards. |
Reinforcement Learning for Self-Improving Agent with Skill Library (2026.acl-long)
Copied to clipboard
Jiongxiao Wang, Qiaojing Yan, Yawei Wang, Yijun Tian, Soumya Smruti Mishra, Zhichao Xu, Megha Gandhi, Panpan Xu, Lin Lee Cheong
| Challenge: | Large Language Model (LLM)-based agents have demonstrated remarkable capabilities in complex reasoning and multi-turn interactions but struggle to continuously improve and adapt when deployed in new environments. |
| Approach: | They propose a Reinforcement Learning-based approach to enhance agents’ self-improvement capabilities with a skill library. |
| Outcome: | The proposed framework achieves 8.9% higher Scenario Goal Completion when applied to supervised-finetuned model with expert experience while requiring 26% fewer interaction steps and generating 59% fewer tokens. |
TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognition (2021.acl-demo)
Copied to clipboard
| Challenge: | TEXTOIR is the first integrated platform for text open intent recognition . currently, many dialogue systems are limited to handle the uncertain open intents . |
| Approach: | TEXTOIR is the first integrated platform for text open intent recognition . it is composed of two main modules: open intent detection and open intent discovery . authors propose a framework to implement a complete process to identify known intents and discover open intents . |
| Outcome: | TEXTOIR is the first integrated and visualized platform for text open intent recognition . it integrates state-of-the-art algorithms and benchmark intent datasets . however, there are still some issues, which bring difficulties for future research . |