Papers by Spencer Lin
Can Vision Language Models Understand Mimed Actions? (2025.findings-acl)
Copied to clipboard
Hyundong Justin Cho, Spencer Lin, Tejas Srinivasan, Michael Saxon, Deuksin Kwon, Natali T. Chavez, Jonathan May
| Challenge: | Nonverbal communication (NVC) is an integral part of human language, but it has been overlooked in natural language processing research. |
| Approach: | They propose a multimodal multimodal recognition task that uses a corpus of mimed gestures to evaluate their understanding of NVC. |
| Outcome: | The proposed task is based on 86 unique gestures with perturbations applied to avatar, background, and viewpoint for evaluating recognition robustness. |
GAIA: A Fine-grained Multimedia Knowledge Extraction System (2020.acl-demos)
Copied to clipboard
Manling Li, Alireza Zareian, Ying Lin, Xiaoman Pan, Spencer Whitehead, Brian Chen, Bo Wu, Heng Ji, Shih-Fu Chang, Clare Voss, Daniel Napierski, Marjorie Freedman
| Challenge: | Open source knowledge extraction tools are used for many real-world applications, but there is no comprehensive system for KE. |
| Approach: | They propose a multimedia knowledge extraction system that takes multimedia data from various sources and languages as input and creates a coherent, structured knowledge base. |
| Outcome: | The system achieves top performance at the recent NIST TAC SM-KBP2019 evaluation. |
Multilingual Entity, Relation, Event and Human Value Extraction (N19-4)
Copied to clipboard
| Challenge: | Existing systems that extract knowledge elements from multiple languages and documents do not aggregate knowledge from multiple documents and languages. |
| Approach: | They propose a multilingual knowledge extraction system that performs entity discovery and linking, relation extraction, event extraction, and coreference. |
| Outcome: | The proposed system performs entity discovery and linking, relation extraction, event extraction, and coreference. |