Challenge: Existing approaches to reward modeling in reinforcement learning tasks are limited when dealing with ambiguous preferences.
Approach: They propose to use AAM to dynamically calibrate preference margins using the Bradley-Terry model's internal parameter knowledge to improve reward modeling in subjective tasks.
Outcome: The proposed approach improves reward modeling by dynamically calibrating preference margins using the model’s internal parameter knowledge.

Similar Papers

APLOT: Robust Reward Modeling via Adaptive Preference Learning with Optimal Transport (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that RLHF improves performance of Large Language Models . BT-based RMs struggle to distinguish between similar preference responses .
Approach: They propose to enhance BT-based reward models by using an adaptive margin mechanism . they use semantic similarity and reward-predicted reward differences to adjust focus .
Outcome: Experimental results show that the proposed method outperforms existing methods in both in-distribution and OOD settings.
PaTaRM: Bridging Pairwise and Pointwise Signals via Preference-Aware Task-Adaptive Reward Modeling (2026.acl-long)

Copied to clipboard

Challenge: Existing reward models lack generative and reasoning capabilities, resulting in poor performance.
Approach: They propose a reward-aware task-adaptive reward model that enables pointwise training using readily available pairwise data via a novel Preference-Aware Reward mechanism.
Outcome: The proposed reward model achieves an average relative improvement of 8.7% over the base models on RewardBench and RMBench.
AMoPO: Adaptive Multi-objective Preference Optimization without Reward Models and Reference Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing multi-objective preference alignment methods for large language models face limitations such as auxiliary reward/reference models and computational complexity.
Approach: They propose a framework that achieves dynamic balance across preference dimensions by using dimension-aware generation metrics as implicit rewards.
Outcome: Empirical results show that AMoPO outperforms state-of-the-art methods by 28.5% .
Don’t Forget Your Reward Values: Language Model Alignment via Value-based Calibration (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for generating large language models have been criticized for their complexity and instability.
Approach: They propose a value-based calibration method to better align Large Language Models with human preferences.
Outcome: The proposed method surpasses existing methods on AI assistant and summarization datasets, providing impressive generalizability, robustness, and diversity in different settings.
Adversarial Preference Optimization: Enhancing Your Alignment via RM-LLM Game (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for training large language models require additional annotations to adjust to shifted distributions.
Approach: They propose an algorithm that allows LLMs and reward models to update alternatively via a min-max game to improve their alignment.
Outcome: The proposed framework improves existing alignment baselines in terms of LLM helpfulness and harmlessness.
AdaJudge: Adaptive Multi-Perspective Judging for Reward Modeling (2026.acl-long)

Copied to clipboard

Challenge: Existing reward models rely on a static pooling strategy to condense sequences into scalar scores, which is ill-suited for fine-grained discrimination.
Approach: They propose a framework that jointly adapts representation and aggregation to address these limitations by integrating a static inductive bias with a representational mismatch.
Outcome: Experiments on RM-Bench and JudgeBench show that AdaJudge outperforms strong off-the-shelf reward models and traditional pooling baselines.
Self-Guided Alignment: Adaptive Preference Sensing for Multi-Objective Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to align LLMs with diverse human values rely on ground-truth scores . existing approaches implicitly approximate an average-user preference, thereby failing to capture heterogeneity of human values or accommodate conflicting user needs.
Approach: They propose a framework that transforms passive reward dependency into an intrinsic adaptive sensing capability.
Outcome: The proposed framework outperforms state-of-the-art models in multiple model scales and improves preference alignment.
MiCRo: Mixture Modeling and Context-aware Routing for Personalized Preference Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing reward models assume a global reward function, limiting personalization and pluralistic alignment.
Approach: They propose a framework that leverages binary preference datasets to enhance personalized preference learning.
Outcome: The proposed framework captures diverse human preferences without fine-grained annotations and significantly improves personalized preference learning on downstream tasks.
Margin Matching Preference Optimization: Enhanced Model Alignment with Granular Feedback (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for large language models rely on binary labels that fail to capture the subtle differences in relative quality between pairs.
Approach: They propose a method that incorporates relative quality margins into optimization to improve LLM policies and reward models.
Outcome: The proposed approach outperforms baseline methods on popular benchmarks including MT-bench and RewardBench.
From Outcomes to Processes: Guiding PRM Learning from ORM for Inference-Time Alignment (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to align large language models with human preferences suffer from inconsistent scoring and suboptimal alignment.
Approach: They propose a dual-consistency framework that aligns partial sequences with human preferences.
Outcome: The proposed framework significantly reduces granularity discrepancies and improves GPT-4 evaluation scores.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations