Papers with Prediction-EXplanation
A Necessary Step toward Faithfulness: Measuring and Improving Consistency in Free-Text Explanations (2025.emnlp-main)
Copied to clipboard
| Challenge: | a measure of faithful free-text explanations is difficult to generate by language models and assess by humans. |
| Approach: | They propose a measure of Prediction-EXplanation consistency by extending the concept of weight of evidence. |
| Outcome: | The proposed measure improves explanation faithfulness by up to 9.7%, the authors show . they show that applying preference optimization improves the consistency of generated explanations across three model families. |