Papers by Naomi Caselli
The American Sign Language Knowledge Graph: Infusing ASL Models with Linguistic Knowledge (2025.findings-naacl)
Copied to clipboard
| Challenge: | Sign language models could make language technologies more accessible to deaf and hard-of-hearing signers, but the supply of accurately labeled data struggles to meet the demand associated with training large, end-to-end architectures. |
| Approach: | They construct an American Sign Language Knowledge Graph from 11 sources of linguistic knowledge and use it to train neuro-symbolic models on ASL video input tasks. |
| Outcome: | The proposed model achieves 91% accuracies for isolated sign recognition, 14% for predicting the semantic features of unseen signs, and 36% for classifying the topic of Youtube-ASL videos. |