Papers by Jiale Chang

Copied to clipboard

Challenge:	Existing approaches to hallucination mitigation ignore heterogeneous behaviors of attention heads . hallucinosity is a critical barrier to multimodal large language models' reliability, authors say .
Approach:	They propose a framework that quantifies the energetic properties of each attention head during object generation through two potential networks and dynamically adjusts their contributions at inference time.
Outcome:	The proposed framework reduces hallucination rates without fine-tuning the base model while maintaining generation quality.