Papers with END
Improve Decoding Factuality by Token-wise Cross Layer Entropy of Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) often struggle with the issue of generating inaccurate or fabricated content even when they possess correct knowledge. |
| Approach: | They propose a decoding method that mitigates hallucinations without extra training . they propose entropy eNhanced decoding that leverages inner probability changes . |
| Outcome: | The proposed method improves the truthfulness and informativeness of generation while maintaining robust QA accuracy. |