Papers by Junliang Du
MAFMO: Multi-modal Adaptive Fusion with Meta-template Optimization for Vision-Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches focus on single-modality adjustments, leading to suboptimal alignment and limited generalization. |
| Approach: | They propose a plug-and-play framework for visual recognition that integrates a Harmonic Cross-Modal Adapter and a Meta-Template Optimization module. |
| Outcome: | Extensive experiments across multiple fine-grained visual recognition benchmarks show that MAFMO consistently improves existing methods’ performance on both novel classes and harmonic mean while maintaining robustness under various challenging conditions with minimal computational overhead. |
DAPE-BR: Distance-Aware Positional Encoding for Mitigating Object Hallucination in LVLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Vision–Language Models (LVLMs) suffer from object hallucination, generating descriptions for objects that are absent from the image, which undermines reliability and hinders real-world deployment. |
| Approach: | They propose a positional-alignment scheme that preserves pretrained weight order while globally—- visual–text distances, embeds an isotropic fused patch-distance metric, and applies a patch-delay causal mask to enforce spatial causality. |
| Outcome: | Extensive experiments on POPE, MMStar and SQA show that DAPE-BR reduces hallucinations and boosts performance. |