Papers by Ammon Shurtz
Neuron-Level Language Tag Injection Improves Zero-Shot Translation Performance (2025.acl-srw)
Copied to clipboard
| Challenge: | Language tagging is a method that trains models on specific language directions . injection is based on a language token embedded in the input layer . |
| Approach: | They propose a method whereby source and target inputs are prefixed with a unique language token and inject it into the input of every linear layer. |
| Outcome: | The proposed method improves translation performance with up to 2+ BLEU score point gain for certain language directions in a multilingual dataset. |
Kreyòl-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languages (2024.naacl-long)
Copied to clipboard
Nathaniel Robinson, Raj Dabre, Ammon Shurtz, Rasul Dent, Onenamiyi Onesi, Claire Monroc, Loïc Grobol, Hasan Muhammad, Ashi Garg, Naome Etori, Vijay Murari Tiyyala, Olanrewaju Samuel, Matthew Stutzman, Bismarck Odoom, Sanjeev Khudanpur, Stephen Richardson, Kenton Murray
| Challenge: | Creole languages are used in much of Latin America, Africa and the Caribbean . a large multilingual bitext like ours has potential to build the best yet or first ever MT models for many languages . |
| Approach: | They present the largest cumulative dataset to date for Creole language MT . they provide MT models supporting all 41 Creoles in 172 translation directions . |
| Outcome: | The proposed model outperforms a genre-specific Creole MT model on its own benchmark for 23 of 34 translation directions. |
The Effects of Pretraining in Video-Guided Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to improve VMT models integrate text and video modalities. |
| Approach: | They propose an approach that improves the performance of VMT models by using a new dataset which contains transcribed audio descriptions of movies. |
| Outcome: | The proposed model improves on the MAD (Movie Audio Descriptions) dataset. |