Papers by Shanming Yao
DAPE-BR: Distance-Aware Positional Encoding for Mitigating Object Hallucination in LVLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Vision–Language Models (LVLMs) suffer from object hallucination, generating descriptions for objects that are absent from the image, which undermines reliability and hinders real-world deployment. |
| Approach: | They propose a positional-alignment scheme that preserves pretrained weight order while globally—- visual–text distances, embeds an isotropic fused patch-distance metric, and applies a patch-delay causal mask to enforce spatial causality. |
| Outcome: | Extensive experiments on POPE, MMStar and SQA show that DAPE-BR reduces hallucinations and boosts performance. |