Papers by Bennett Stankovits
The Aligned Multimodal Movie Treebank: An audio, video, dependency-parse treebank (2022.emnlp-main)
Copied to clipboard
Adam Yaari, Jan DeWitt, Henry Hu, Bennett Stankovits, Sue Felshin, Yevgeni Berzak, Helena Aparicio, Boris Katz, Ignacio Cases, Andrei Barbu
| Challenge: | Existing treebanks derived from text include only text and are based on single-modality texts. |
| Approach: | They propose to use audio-visual transcripts and part of speech tags to create an English language treebank based on dialog in Hollywood movies. |
| Outcome: | The proposed treebank is the 3rd largest UD English treebank and the only multimodal treebank in UD. |