Papers by Aranyak Mehta
Conditional Language Policy: A General Framework For Steerable Multi-Objective Finetuning (2024.findings-emnlp)
Copied to clipboard
Kaiwen Wang, Rahul Kidambi, Ryan Sullivan, Alekh Agarwal, Christoph Dann, Andrea Michi, Marco Gelmi, Yunxuan Li, Raghav Gupta, Kumar Dubey, Alexandre Rame, Johan Ferret, Geoffrey Cideron, Le Hou, Hongkun Yu, Amr Ahmed, Aranyak Mehta, Leonard Hussenot, Olivier Bachem, Edouard Leurent
| Challenge: | Existing approaches for multi-objective Reinforcement Learning (RL) are difficult due to plurality of preferences and applications. |
| Approach: | They propose a framework for finetuning language models on multiple objectives using conditional language policy. |
| Outcome: | The proposed framework outperforms and Pareto-dominates existing approaches for multi-objective Reinforcement Learning (RL) it does not require training or maintaining multiple models to achieve different trade-offs between the objectives. |