Papers by Lulu Wang
Seen to Unseen: Exploring Compositional Generalization of Multi-Attribute Controllable Dialogue Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing controllable dialogue generation models focus on single attribute and lack generalization capability to out-of-distribution multiple attribute combinations. |
| Approach: | They propose a compositional generalization model that learns from seen attributes and generalizes to unseen combinations. |
| Outcome: | The proposed model can learn from seen attribute values and generalize to unseen combinations. |
PSC: Extending Context Window of Large Language Models via Phase Shift Calibration (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale language models (LLMs) have shown impressive results across a variety of tasks. |
| Approach: | They propose a module for calibrating the frequencies predefined by existing methods . they conducted extensive experiments across multiple models and tasks . |
| Outcome: | The proposed method reduces perplexity as the context window size is varied from 16k to 32k and up to 64k. |
MPPO: Multi Pair-wise Preference Optimization for LLMs with Arbitrary Negative Samples (2025.coling-main)
Copied to clipboard
Shuo Xie, Fangzhi Zhu, Jiahui Wang, Lulu Wen, Wei Dai, Xiaowei Chen, Junxiong Zhu, Kai Zhou, Bo Zheng
| Challenge: | Existing preference optimization methods such as DPO and KTO are inherently derived from PPO, requiring a reference model that adds GPU memory resources and relies heavily on abundant preference data. |
| Approach: | They propose an algorithm that leverages the average likelihood of model responses to fit the reward function and maximizes the utilization of preference data. |
| Outcome: | The proposed algorithm outperforms DPO, ORPO, and SimPO on MT-Bench and Arena-Hard. |
SGDPO: Self-Guided Direct Preference Optimization for Language Model Alignment (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for aligning Large Language Models with human values are limited and results of DPO are not resilient. |
| Approach: | They propose a self-guided direct preference optimization algorithm that incorporates a pilot term to steer the gradient flow during the optimization process. |
| Outcome: | The proposed method can generate human-preferred response up to 9.19% higher than previous methods. |