Papers by Carlos Escolano
Unmasking Biases: Exploring Gender Bias in English-Catalan Machine Translation through Tokenization Analysis and Novel Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | a new dataset focuses on gender-neutral terms that necessitate gendered translations in Catalan. |
| Approach: | They propose to use a new dataset to evaluate gender bias in machine translation . they train four MT systems using different tokenization techniques . |
| Outcome: | The proposed dataset focuses on gender-neutral terms necessitating gendered translations in Catalan. |
Multilingual Machine Translation: Closing the Gap between Shared and Language-specific Encoder-Decoders (2021.eacl-main)
Copied to clipboard
| Challenge: | State-of-the-art multilingual machine translation relies on a universal encoder-decoder, which requires retraining the entire system to add new languages. |
| Approach: | They propose an encoder-decoder approach that can be extended to new languages by learning their corresponding modules. |
| Outcome: | The proposed approach outperforms the universal encoder-decoder by 3.28 BLEU points on average while allowing to add new languages without retraining the rest of the modules. |
From Bilingual to Multilingual Neural Machine Translation by Incremental Training (P19-2)
Copied to clipboard
| Challenge: | Existing approaches to multilingual neural machine translation are based on task specific models and the addition of one more language is only possible by retraining the whole system. |
| Approach: | They propose a training schedule that scales to more languages without modification of previous components. |
| Outcome: | The proposed training schedule shows close results to state-of-the-art in the WMT task. |
Towards Opening the Black Box of Neural Machine Translation: Source and Target Interpretations of the Transformer (2022.emnlp-main)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) relies on source sentence and target prefix attributions for each input token. |
| Approach: | They propose an interpretability method that tracks input tokens’ attributions for both contexts and extends it to any encoder-decoder Transformer-based model. |
| Outcome: | The proposed method can be extended to any encoder-decoder Transformer-based model and provides insights into their behaviour. |
Multilingual, Multi-scale and Multi-layer Visualization of Intermediate Representations (D19-3)
Copied to clipboard
| Challenge: | Currently, the main alternatives to deal with sequences are Recurrent Neural Networks (RNN) architectures and the Transformer. |
| Approach: | They propose a web-based tool that visualizes the sentence and token representations of RNNs and Transformer architectures at the sentence level. |
| Outcome: | The proposed visualization tool analyses gender inequalities in contextual word embeddings and the common language representation in a multilingual machine translation system. |
Toxicity in Multilingual Machine Translation at Scale (2023.findings-emnlp)
Copied to clipboard
Marta Costa-jussà, Eric Smith, Christophe Ropers, Daniel Licht, Jean Maillard, Javier Ferrando, Carlos Escolano
| Challenge: | In this paper, we evaluate and analyze added toxicity when translating a large dataset from English into 164 languages. |
| Approach: | They evaluate added toxicity when translating a large dataset from English into 164 languages. |
| Outcome: | The results show that added toxicity is more prevalent in low-resource languages than in high-resolution translations. |