Papers by Liu Hanze
Mitigating the Alignment Tax of RLHF (2024.emnlp-main)
Copied to clipboard
Yong Lin, Hangyu Lin, Wei Xiong, Shizhe Diao, Jianmeng Liu, Jipeng Zhang, Rui Pan, Haoxiang Wang, Wenbin Hu, Hanning Zhang, Hanze Dong, Renjie Pi, Han Zhao, Nan Jiang, Heng Ji, Yuan Yao, Tong Zhang
| Challenge: | Large Language Models (LLMs) acquire a wide range of abilities during pre-training, but aligning LLMs under Reinforcement Learning with Human Feedback (RLHF) can lead to forgetting pretrained abilities, which is also known as the alignment tax. |
| Approach: | They propose to use a model averaging technique to find the most powerful alignment-forging Pareto front among RLHF algorithms. |
| Outcome: | The proposed method achieves the strongest alignment-forging Pareto front among competing methods. |
Towards Singable Lyrics Translation Using Large Language Models (2026.eacl-srw)
Copied to clipboard
| Challenge: | Existing studies on lyrics translation have relied on fine-tuning open-source language models. |
| Approach: | They examine a multilingual lyrics translation dataset and apply prompting methods to large language models to evaluate singability. |
| Outcome: | The proposed methods improve singability and naturalness, compared to naive translation, the authors show . human evaluations using songs created from translated lyrics show that complex prompting strategies improve singable naturalness . |
Open-World Planning via Lifted Regression with LLM-Inferred Affordances for Embodied Agents (2025.acl-long)
Copied to clipboard
Xiaotian Liu, Ali Pesaranghader, Hanze Li, Punyaphat Sukcharoenchaikul, Jaehong Kim, Tanmana Sadhu, Hyejeong Jeon, Scott Sanner
| Challenge: | Existing open-world planning methods rely on closed-world assumption (CWA) symbolic planners face combinatorial explosion of states and actions due to reliance on grounding. |
| Approach: | They propose an open-world planning approach integrating lifted regression with LLM-generated affordances. |
| Outcome: | The proposed approach outperforms state-of-the-art LLM planners and a grounded planner on three benchmarks. |