Papers by Alessio Galatolo
Visualising Policy-Reward Interplay to Inform Zeroth-Order Preference Optimisation of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | ZOPrO is a novel algorithm designed for *Preference Optimisation* in large language models. |
| Approach: | They propose a ZO algorithm designed for *Preference Optimisation* in LLMs that uses function evaluations instead of gradients to reduce memory usage. |
| Outcome: | The proposed method improves reward signals while achieving convergence times comparable to first-order methods. |