Papers by Alina Karakanta
Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference? (2021.acl-long)
Copied to clipboard
Luisa Bentivogli, Mauro Cettolo, Marco Gaido, Alina Karakanta, Alberto Martinelli, Matteo Negri, Marco Turchi
| Challenge: | a gap between direct approaches to speech translation (ST) and traditional cascade solutions has gradually decreased . a recent study found that the subtle differences observed in their behavior are not sufficient for humans neither to distinguish them nor to prefer one over the other. |
| Approach: | They compare state-of-the-art systems representative of the two paradigms . they find subtle differences observed in their behavior are not sufficient . |
| Outcome: | The proposed system is compared with state-of-the-art systems representative of the two paradigms. |
MuST-Cinema: a Speech-to-Subtitles corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for subtitling are laborious and costly, says aaron sanchez . he says the current methods are laboriously complex and require manual work . |
| Approach: | They propose to use TED subtitles to build a multilingual speech translation corpus . they propose to annotate existing subtitling corpora with subtitle breaks . |
| Outcome: | The proposed model can be used to segment sentences into subtitles and reduces human work . the proposed model reduces the time and cost of human subtitling tasks . |
Dodging the Data Bottleneck: Automatic Subtitling with Automatically Segmented ST Corpora (2022.aacl-short)
Copied to clipboard
| Challenge: | Existing models for subtitling require parallel data paired with audio inputs and textual translations. |
| Approach: | They propose to convert existing ST corpora into SubST resources without human intervention by exploiting audio and text in a multimodal fashion. |
| Outcome: | The proposed model achieves high segmentation quality in zero-shot conditions with manual and automatic segmentation. |
Direct Speech Translation for Automatic Subtitling (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing models for automatic subtitling generate subtitles in the target language along with their timestamps. |
| Approach: | They propose a direct speech translation model that generates subtitles in the target language along with their timestamps with a single model. |
| Outcome: | The proposed model outperforms a cascade system on 7 language pairs and on new benchmarks. |
Evaluating Subtitle Segmentation for End-to-end Generation Systems (2022.lrec-1)
Copied to clipboard
| Challenge: | Subtitle segmentation can be evaluated with sequence segmentation metrics against a human reference, but cannot be applied when systems generate outputs different than the reference, e.g. with end-to-end subtitling systems. |
| Approach: | They propose to use Sigma to evaluate subtitle segmentation against a human reference and a boundary projection method to disentangle the effect of good segmentation from text quality. |
| Outcome: | The proposed method disentangles the effect of good segmentation from text quality and is compared with existing metrics. |
Evaluating Automatic Subtitling: Correlating Post-editing Effort and Automatic Metrics (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing metrics for automatic subtitling are not yet fully explored. |
| Approach: | They propose to use machine translation metrics to measure post-editing effort in automatic subtitling to collect data on product-, process- and participant-based data. |
| Outcome: | The proposed metrics correlate with measures of post-editing effort in automatic subtitling. |
The Two Shades of Dubbing in Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Dubbing has two shades; synchronisation constraints are applied only when the actor’s mouth is visible on screen, while the translation is unconstrained for off-screen dubbing. |
| Approach: | They annotate an existing dubbing corpus for this dichotomy and find that on-screen dubbing is more difficult for MT than off-screen. |
| Outcome: | The results show that on-screen dubbing is more difficult for MT than off-screen translation, and that synchronisation constraints dramatically decrease translation quality for off- screen dubbing. |