Papers by Zhenglin Hua
Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence (2025.acl-long)
Copied to clipboard
Jinghan He, Kuan Zhu, Haiyun Guo, Junfeng Fang, Zhenglin Hua, Yuheng Jia, Ming Tang, Tat-Seng Chua, Jinqiao Wang
| Challenge: | Existing methods focus on alignment training or decoding refinements but address symptoms at the generation stage without probing the underlying causes. |
| Approach: | They propose a training-free approach to mitigate hallucination by enhancing the role of vision-aware attention heads. |
| Outcome: | The proposed method achieves superior performance compared to state-of-the-art approaches in mitigating hallucinations while maintaining high efficiency with negligible additional time overhead. |
Steering LVLMs via Sparse Autoencoder for Hallucination Mitigation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to address hallucinations in large vision-language models require substantial computational cost and time. |
| Approach: | They propose to leverage sparse autoencoders to identify semantic directions closely associated with faithfulness or hallucination, extracting more precise and disentangled hallucinian-related representations. |
| Outcome: | The proposed method outperforms existing decoding approaches while maintaining transferability across different model architectures with negligible additional time overhead. |