Papers by Hamidullah Yasser
DualFact+: A Multimodal Fact Verification Framework for Procedural Video Captioning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation metrics fail to evaluate factual correctness in procedural video captions . Existing metrics rely on lexical overlap or holistic semantic similarity, but miss role-specific omissions resulting in hallucinations . |
| Approach: | They propose a role-aware, fact-level evaluation framework that distinguishes conceptual facts from contextual facts. |
| Outcome: | Experiments show that state-of-the-art captioning models produce fluent but incomplete descriptions with systematic errors. |
Sign Language Video Segmentation Using Temporal Boundary Identification (2025.acl-srw)
Copied to clipboard
| Challenge: | Sign language segmentation focuses on identifying temporal boundaries within video . previous methods have relied on frame-level and phrase-level segmentation. |
| Approach: | They propose to use synchronized subtitle data to facilitate temporal boundary recognition by a sequence-to-sequence model with and without attention for subtitle boundary identification. |
| Outcome: | The proposed model outperforms baseline models on optical flow data and aligned subtitles from BOBSL and YouTube-ASL. |
Sign Language Translation with Sentence Embedding Supervision (2024.acl-short)
Copied to clipboard
| Challenge: | State-of-the-art sign language translation systems facilitate learning through gloss annotations when available at scale. |
| Approach: | They propose to use sentence embeddings of the target sentences at training time that take the role of glosses to supervise the learning process. |
| Outcome: | The proposed method significantly outperforms gloss-free approaches on German and American sign languages and with mono- and multilingual sentence embeddings and translation systems. |