Papers by Yuling Yang
Mulan: A Multi-Level Alignment Model for Video Question Answering (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods focus on visual-language alignment at the video level, but they do not account for fine-grained semantic interaction between video and text. |
| Approach: | They propose a multi-level Alignment Model for Video Question Answering that establishes alignment between visual and textual modalities at the object-level, frame-level and video-level. |
| Outcome: | The proposed model outperforms state-of-the-art methods even with a small amount of extra visual-language pre-training data and a reduced number of trainable parameters. |
DMSD: Dual-Modal Semantic Disentanglement for Compositional Zero-Shot Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Compositional Zero-Shot Learning (CZSL) is a new research paradigm that learns sub-concepts from seen compositions and recognizes unseen novel combinations. |
| Approach: | They propose a Dual-Modal Semantic Disentanglement framework that integrates visual and textual information to achieve effective sub-concept disentangling. |
| Outcome: | The proposed framework achieves state-of-the-art performance on three benchmark datasets . it integrates a class-centroid bridge module to guide class centroids toward the textual space . |