Papers by Hyunkyu Choi
End-to-End Multilingual Automatic Dubbing via Duration-based Translation with Large Language Models (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Automatic dubbing (AD) aims to replace the original speech with translated speech that maintains precise temporal alignment (isochrony). |
| Approach: | They propose an end-to-end automatic dubbing framework that leverages large language models to integrate translation and timing control seamlessly. |
| Outcome: | The proposed framework achieves up to 24% relative gains on English, Spanish, and Korean language pairs while maintaining competitive translation quality measured by COMET scores. |