PyMarian: Fast Neural Machine Translation and Evaluation in Python (2024.emnlp-demo)
Copied to clipboard
| Challenge: | a Python interface to Marian NMT is available in PyPI via pip install pymarian . the interface provides a speedup factor of up to 7.8 the existing implementations . |
| Approach: | They propose a Python interface to Marian NMT, a C++-based training and inference toolkit for sequence-to-sequence models. |
| Outcome: | The proposed interface enables models trained with Marian to be connected to Python tools with a speedup factor of up to 7.8 the existing implementations. |
Similar Papers
Marian: Fast Neural Machine Translation in C++ (P18-4)
Copied to clipboard
Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, André F. T. Martins, Alexandra Birch
| Challenge: | In this paper, we present Marian, an efficient and self-contained Neural Machine Translation framework . Marian is written in pure C++ with minimal dependencies . |
| Approach: | They present Marian, an efficient and self-contained Neural Machine Translation framework written in pure C++ with minimal dependencies. |
| Outcome: | The proposed framework achieves high training and translation speed with minimal dependencies . it is currently being deployed in multiple European projects . |
PyMT5: multi-mode translation of natural language and Python code with transformers (2020.emnlp-main)
Copied to clipboard
| Challenge: | Using Python method text-to-text transfer transformers, developers can easily model source code and natural language. |
| Approach: | They propose a Python method text-to-text transfer transformer that can translate between all pairs of Python method feature combinations. |
| Outcome: | The proposed model outperforms similar-sized auto-regressive language models on a large-scale parallel corpus of 26 million methods and 7.7 million method-docstring pairs on the CodeSearchNet test set. |
CytonMT: an Efficient Neural Machine Translation Open-source Toolkit Implemented in C++ (D18-2)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has made remarkable progress over the past few years. |
| Approach: | They propose to use C++ and NVIDIA’s GPU-accelerated libraries to build an open-source neural machine translation toolkit called CytonMT. |
| Outcome: | The proposed toolkit accelerates the training speed by 64.5% to 110.8% on neural networks of various sizes, and achieves competitive translation quality. |
COMET: A Neural Framework for MT Evaluation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Historically, metrics for evaluating the quality of machine translation (MT) have relied on basic, lexical-level features such as counting the number of matching n-grams between the MT hypothesis and the reference translation. |
| Approach: | They propose a neural framework for training multilingual machine translation evaluation models which exploits human judgements to obtain new state-of-the-art levels of correlation with MT quality. |
| Outcome: | The proposed framework achieves state-of-the-art performance on the WMT 2019 Metrics shared task and demonstrate robustness to high-performing systems. |
Simul-LLM: A Framework for Exploring High-Quality Simultaneous Translation with Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Modern large language models (LLMs) contain billions of parameters and can perform a variety of downstream tasks. |
| Approach: | They propose an open-source framework for fine-tuning large language models (LLMs) they address key challenges facing LLMs fine- tuned for simultaneous translation . |
| Outcome: | The proposed framework validates classical SimulMT concepts and practices in the context of LLMs and explores adapting LLM fine-tuned for NMT to the task of Simul-LLM. |
Universal Conditional Masked Language Pre-training for Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Pre-trained sequence-to-sequence models have significantly improved Neural Machine Translation (NMT) this paper demonstrates that pre-training a sequence- to-squence model with a bidirectional decoder can produce notable performance gains for both Autoregressive and Non-autoregressive NMT tasks. |
| Approach: | They propose a conditional masked language model pre-trained on bilingual and monolingual corpora in many languages. |
| Outcome: | The proposed model can achieve significant performance improvements on all scenarios from low- to extremely high-resource languages. |
MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki (2024.eacl-demo)
Copied to clipboard
Timothee Mickus, Stig-Arne Grönroos, Joseph Attieh, Michele Boggia, Ona De Gibert, Shaoxiong Ji, Niki Andreas Loppi, Alessandro Raganato, Raúl Vázquez, Jörg Tiedemann
| Challenge: | a growing trend towards modularization is limiting the size and information that can be handled in large language models. |
| Approach: | They propose a framework for training massively multilingual modular machine translation systems at scale. |
| Outcome: | The proposed framework is adapted to train multilingual models at scale on NVIDIA GPUs. |
A Large-Scale Study of Machine Translation in Turkic Languages (2021.emnlp-main)
Copied to clipboard
Jamshidbek Mirzakhalov, Anoop Babu, Duygu Ataman, Sherzod Kariev, Francis Tyers, Otabek Abduraufov, Mammad Hajili, Sardana Ivanova, Abror Khaytbaev, Antonio Laverghetta Jr., Bekhzodbek Moydinboyev, Esra Onal, Shaxnoza Pulatova, Ahsan Wahab, Orhan Firat, Sriram Chellappan
| Challenge: | a large corpus covering 22 Turkic languages is included in this paper . low-resource MT evaluation has traditionally focused on European languages due to limitations of available technology and resources. |
| Approach: | They present a case study of the practical application of MT in the Turkic language family . they propose to realize the gains of NMT for Turkic languages under high-resource to extremely low-resourced scenarios. |
| Outcome: | The proposed study shows that the new methods can be used in the Turkic language family . the results highlight bottlenecks in building competitive systems . |
English-Basque Statistical and Neural Machine Translation (L18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) requires large training corpora, which is problematic for low-resource languages. |
| Approach: | They propose to use an open-domain and an IT-domain corpora to train machine translations in English-Basque. |
| Outcome: | The proposed systems outperform OpenNMT, Moses SMT and Google Translate in English-Basque translation. |
xLM: A Python Package for Non-Autoregressive Language Models (2026.eacl-demo)
Copied to clipboard
| Challenge: | Autoregressive language models generate text sequentially from left to right by adding one token at a time. |
| Approach: | They propose a python package that provides a suite of small non-autoregressive language models that can be used by researchers. |
| Outcome: | The proposed package makes implementing small non-autoregressive language models faster and provides a suite of pre-trained models that can be used by the research community. |