Papers by David Rabinowitz

Copied to clipboard

Challenge:	Current guardrails overfit the training policies, preventing adaptation to new domains and policies.
Approach:	They propose a training recipe that uses a suite of policy perturbation strategies to reduce overfitting and increase generalization to guardrails.
Outcome:	The proposed training recipe reduces overfitting and increases generalization on unseen policies and achieves comparable or better performance than existing 8B guardrails on unsen policies.