Papers by Johnathan Xie
Calibrating Language Models with Adaptive Temperature Scaling (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models' confidence scores are degraded after fine-tuning with reinforcement learning from human feedback. |
| Approach: | They propose a post-hoc calibration method that predicts a temperature scaling parameter for each token prediction. |
| Outcome: | Adaptive temperature scaling improves calibration by over 10% compared to prior methods . RLHF fine-tuning improves model accuracy, but degradation is not significant . |