Papers by Diane Brentari
Open-Domain Sign Language Translation Learned from Online Video (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on sign language translation has focused mainly on data collected in controlled environments or domains, which limits its applicability to real-world settings. |
| Approach: | They propose to use sign search as a pretext task and fusion of mouthing and handshape features to improve sign language translation in real-world settings. |
| Outcome: | The proposed techniques produce consistent and large improvements over baseline models based on prior work. |
Searching for fingerspelled content in American Sign Language (2022.acl-long)
Copied to clipboard
| Challenge: | Sign language processing is gaining interest in the computer vision and natural language processing communities. |
| Approach: | They propose a model that jointly detects fingerspelling and matches it to a text sequence. |
| Outcome: | The proposed model outperforms baseline methods on a large public dataset of ASL fingerspelling in the wild. |