Papers with pivoting
Multilingual Neural Machine Translation (2020.coling-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will cover the latest advances in NMT to enhance low-resource translation. |
| Approach: | They will cover the latest advances in NMT approaches that leverage multilingualism . they will focus on topics such as language divergence, transfer learning and pivoting . |
| Outcome: | This tutorial will cover the latest advances in NMT to enhance low-resource translation models. |
Cross2StrA: Unpaired Cross-lingual Image Captioning with Cross-lingual Cross-modal Structure-pivoted Alignment (2023.acl-long)
Copied to clipboard
| Challenge: | Current captioning models are limited to the English language due to the largescale paired image-caption datasets. |
| Approach: | They propose to integrate the scene graph (SG) structures and the syntactic constituency trees into a captioner to improve captioning relevancy and fluency. |
| Outcome: | The proposed model improves captioning relevancy and fluency on English-Chinese transfers. |
Topic Sensitive Attention on Generic Corpora Corrects Sense Bias in Pretrained Embeddings (P19-1)
Copied to clipboard
| Challenge: | Existing methods to adapt pretrained embeddings to a large corpus are limited and do not provide sufficient quality. |
| Approach: | They propose to use a small corpus D_T to pretrain embeddings that accurately capture the sense of words in a limited set of focused topics. |
| Outcome: | The proposed embeddings capture the sense of words in a topic in spite of the limited size of the corpus D_T. |
Neural Machine Translation between Low-Resource Languages with Synthetic Pivoting (2024.lrec-main)
Copied to clipboard
| Challenge: | Pivot-based neural machine translation systems overcome data scarcity by including a high-resource pivot language in the process of translating between low-resourced languages. |
| Approach: | They propose a novel approach to pivot-based translation in which pivot sentences are generated synthetically from both the source and target languages. |
| Outcome: | The proposed approach improves pivot-based systems translating between low-resource Southern African languages by up to 5.6 BLEU points after fine-tuning. |
Scaling Low-Resource MT via Synthetic Data Generation with LLMs (2025.emnlp-main)
Copied to clipboard
Ona de Gibert, Joseph Attieh, Teemu Vahtola, Mikko Aulamo, Zihao Li, Raúl Vázquez, Tiancheng Hu, Jörg Tiedemann
| Challenge: | a recent study has shown that LLM-generated synthetic data can improve low-resource machine translation performance . traditional data augmentation techniques like back-translation preserve the human-written target and synthesize the other . |
| Approach: | They construct a document-level synthetic corpus from English Europarl and extend it via pivoting to 147 additional language pairs. |
| Outcome: | The proposed model can significantly improve low-resource machine translation performance even when noisy. |