Papers by Chuyue Huang
From Scenes to Elements: Multi-Granularity Evidence Retrieval for Verifiable Multimodal RAG (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multimodal Retrieval-Augmented Generation (RAG) systems retrieve evidence at coarse granularities, making failures unverifiable. |
| Approach: | They propose a multimodal benchmark that features real-world landmarks with annotations across multiple viewpoints and a framework that treats visual elements as first-class retrieval units through three stages: element-level detection and classification, multi-granularity cross-modal alignment for evidence retrieval, and attribution-constrained generation. |
| Outcome: | The proposed framework achieves up to 29.2% improvement over six strong baselines for this task. |