Papers by Debashish Chakraborty
Whisper-UT: A Unified Translation Framework for Speech and Text (2025.emnlp-main)
Copied to clipboard
Cihan Xiao, Matthew Wiesner, Debashish Chakraborty, Reno Kriz, Keith Cunningham, Kenton Murray, Kevin Duh, Luis Tavarez-Arce, Paul McNamee, Sanjeev Khudanpur
| Challenge: | Encoder-decoder models have achieved remarkable success in speech and text tasks, but efficiently adapting them to diverse uni/multimodal scenarios remains a challenge. |
| Approach: | They propose a framework that leverages lightweight adapters to enable seamless adaptation across tasks. |
| Outcome: | The proposed framework improves speech translation performance through a 2-stage decoding strategy without requiring 3-way parallel data. |