Papers by Danielle Bragg
Investigating Dictionary Expansion for Video-based Sign Language Dictionaries (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Currently, most dictionary retrieval methods only work with fixed vocabularies, and it is unclear how they might support dictionary expansion without retraining. |
| Approach: | They propose to use a representation-based method to explore the feasibility of dictionary expansion for sign language dictionaries. |
| Outcome: | The proposed method improves sign language dictionaries by varying number of signs added and amount of data for newly added signs. |
ASL STEM Wiki: Dataset and Benchmark for Interpreting STEM Articles (2024.emnlp-main)
Copied to clipboard
Kayo Yin, Chinmay Singh, Fyodor Minakov, Vanessa Milan, Hal Daumé Iii, Cyril Zhang, Alex Lu, Danielle Bragg
| Challenge: | Deaf and hard-of-hearing students face significant barriers in accessing STEM education due to the scarcity of STEM resources in signed languages. |
| Approach: | They develop models to identify fingerspelled words in American Sign Language (ASL) given an English sentence and a video, the model detects which English phrase is fingerspelled in the clip. |
| Outcome: | ASL STEM Wiki is the first continuous signing dataset focused on STEM . it detects fingerspelled words and queries them for appropriate signs to suggest to interpreters. |
Studying and Mitigating Biases in Sign Language Understanding Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Using crowd-sourced sign language datasets to reduce performance disparities is critical to addressing potential biases and inequities. |
| Approach: | They use demographic information to study biases that may result from models trained on crowd-sourced sign datasets. |
| Outcome: | The proposed approach reduces performance disparities without decreasing accuracy. |