Challenge: Existing approaches to provide token-level rewards fail to account for varying degrees of preference inherent to each token.
Approach: They propose a reward model that uses a discriminator to assign token-based continuous rewards to each token considering the context.
Outcome: Extensive experiments show that the proposed reward model improves on open-ended language generation benchmarks.

Similar Papers

T-REG: Preference Optimization with Token-Level Reward Regularization (2025.acl-long)

Copied to clipboard

Challenge: Reinforcement learning from human feedback (RLHF) is a dominant approach for large language models to follow instructions and produce meaningful alignment.
Approach: They propose a method that leverages human feedback to optimize large language models . they propose to use sequence-level and token-level rewards to optimize preference .
Outcome: The proposed method outperforms baseline methods on Alpaca Eval 2 and Arena-Hard benchmarks.
RED: Unleashing Token-Level Rewards from Holistic Feedback via Reward Redistribution (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results demonstrate the superiority of our approach to aligning large language models with human preferences.
Approach: They propose a method that evaluates and assigns specific credit to each token using an off-the-shelf reward model.
Outcome: The proposed method evaluates and assigns specific credit to each token using an off-the-shelf reward model.
ARF-RLHF: Adaptive Reward-Following for RLHF through Emotion-Driven Self-Supervision and Trace-Biased Dynamic Optimization (2026.acl-long)

Copied to clipboard

Challenge: prevailing RLHF methods such as PPO and DPO depend on large-scale binary preference annotations.
Approach: They propose a method which converts natural feedback into continuous preference trajectories and optimizes them using the novel TraceBias algorithm.
Outcome: The proposed approach outperforms PPO and DPO in a variety of domains and improves alignment by up to 7.6% across diverse LLMs and preference domains.
Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappings (2026.tacl-1)

Copied to clipboard

Challenge: Reinforcement learning (RL) is an effective and robust method for training neural machine translation systems.
Approach: They propose a method that leverages fine-grained, token-level quality assessments . they use a state-of-the-art quality estimation system as their token- level reward model .
Outcome: The proposed approach leverages fine-grained, token-level quality assessments along with error severity levels to improve translation quality.
Improving Discriminative Capability of Reward Models in RLHF Using Contrastive Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Current methods rely on ranking losses to teach reward model to assess preferences, but they are susceptible to noise and ambiguous data, often failing to deeply understand human intentions.
Approach: They propose a method that incorporates contrastive learning into the reward modeling process to enhance generalization and stabilize the reinforcement learning training process.
Outcome: The proposed method enhances generalization of the reward model, stabilizes the reinforcement learning training process, and improves the final alignment with human preferences.
AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for LLM alignment optimize tokens using a sparse, response-level reward or preference annotation.
Approach: They propose an RLHF-equivalent distillation method for token-level reward optimization that incorporates the reward learned by DPO into the RLHG objective and builds a token-based teacher distribution.
Outcome: The proposed method bridges the accuracy gap between the reward from the DPO model and the pure reward model by building a contrastive DPO reward with a normal and a reverse DPO.
LIRE: listwise reward enhancement for preference alignment (2024.findings-acl)

Copied to clipboard

Challenge: prevailing approaches to preference alignment focus on pairwise comparisons, with limited exploration into multi-response scenarios.
Approach: They propose a listwise reward enhancement approach that integrates offline rewards of multiple responses into a streamlined listwise framework.
Outcome: The proposed approach outperforms existing methods on dialogue and summarization tasks with good transferability to out-of-distribution data.
Semi-Supervised Reward Modeling via Iterative Self-Training (2024.findings-emnlp)

Copied to clipboard

Challenge: Reward models capture values and preferences of humans and are used in Reinforcement Learning with Human Feedback (RLHF) Traditionally, training large language models relies on extensive human-annotated preference data, which poses significant challenges in terms of scalability and cost.
Approach: They propose a method that enhances RM training using unlabeled data.
Outcome: The proposed approach improves reward models without incurring additional labeling costs on unlabeled datasets.
Aligning Large Language Models via Fine-grained Supervision (2024.acl-short)

Copied to clipboard

Challenge: Pre-trained large-scale language models often generate biased or toxic text, misaligning with human intentions.
Approach: They propose to use human feedback to improve LLM alignment by fine-grained token supervision . they ask annotators to edit less preferred responses to make them more favorable .
Outcome: The proposed method improves LLM alignment by up to 5.1% in terms of win rate compared with the traditional model.
Prototypical Reward Network for Data-Efficient Model Alignment (2024.acl-long)

Copied to clipboard

Challenge: Reinforcement Learning from Human Feedback (RLHF) is a reward model that fine-tunes Large Language Models (LLMs) by utilizing Prototypical Networks.
Approach: They propose a framework utilizing Prototypical Networks to enhance reward models under limited human feedback, enabling more stable and reliable structural learning from fewer samples.
Outcome: The proposed framework improves reward models under limited human feedback, surpassing traditional methods, especially in data-limited scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations