Papers by Jiatao Gu
Meta-Learning for Low-Resource Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm for low-resource neural machine translation (NMT). |
| Approach: | They propose to extend the recently introduced meta-learning algorithm for low-resource neural machine translation (NMT) they frame low-Resource translation as a meta- learning problem where we learn to adapt to low-REsource languages based on multilingual high-resourced language tasks. |
| Outcome: | The proposed meta-learning algorithm outperforms the multilingual, transfer learning based approach and can train a competitive NMT system with only a fraction of training examples. |
Universal Neural Machine Translation for Extremely Low Resource Languages (N18-1)
Copied to clipboard
| Challenge: | a novel multilingual approach to machine translation is proposed for low resource languages . the proposed approach can achieve 23 BLEU on Romanian-English WMT2016 using a tiny parallel corpus of 6k sentences compared to the 18 BLUE of strong baseline system . |
| Approach: | They propose a transfer-learning approach to share lexical and sentence representations across multiple source languages into one target language. |
| Outcome: | The proposed approach achieves 23 BLEU on Romanian-English WMT2016 using a tiny parallel corpus of 6k sentences compared to the 18 BLUE of strong baseline system which uses multi-lingual training and back-translation. |
Non-Autoregressive Sequence Generation (2022.acl-tutorials)
Copied to clipboard
| Challenge: | Non-autoregressive sequence generation (NAR) models generate output sequences in parallel to speed up generation process. |
| Approach: | This tutorial provides a thorough introduction and review of non-autoregressive sequence generation . it aims to generate the entire or partial output sequences in parallel to speed up the generation process . |
| Outcome: | This tutorial provides a thorough introduction and review of non-autoregressive sequence generation . it aims to reduce the performance gap between state-of-the-art models due to lack of modeling power . |
Addressing Posterior Collapse with Mutual Information for Improved Variational Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing variational inference models ignore their latent variables, a phenomenon called posterior collapse. |
| Approach: | They propose a new loss function for conditional variational autoencoders that counteracts posterior collapse by using a modified evidence lower bound objective and a factorized decoder. |
| Outcome: | The proposed model yields improved translation quality compared to existing models on WMT RoEn and DeEn. |
Multilingual Denoising Pre-training for Neural Machine Translation (2020.tacl-1)
Copied to clipboard
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer
| Challenge: | Existing approaches to pre-train models focus on only English corpora, but this is not common in machine translation. |
| Approach: | They propose a sequence-to-sequence denoising auto-encoder pre-trained on monolingual corpora . they show that it produces significant performance gains across MT tasks . |
| Outcome: | The proposed model can achieve significant performance gains across a wide variety of MT tasks. |
fairseq Sˆ2: A Scalable and Integrable Speech Synthesis Toolkit (2021.emnlp-demo)
Copied to clipboard
| Challenge: | Speech synthesis is the task of generating speech waveforms with desired characteristics, including but not limited to textual content, speaker identity, and speaking styles. |
| Approach: | They propose a fairseq extension for speech synthesis that implements autoregressive and non-AR text-to-speech models and their multi-speaker variants. |
| Outcome: | The proposed extension can train autoregressive and non-AR models and their multi-speaker variants with less curated data and has automatic metrics to facilitate faster iteration and analysis. |
VizSeq: a visual analysis toolkit for text generation tasks (D19-3)
Copied to clipboard
| Challenge: | Several softwares for text evaluation are available that do not provide detailed examples. |
| Approach: | They propose a visual analysis toolkit for instance-level and corpus-level system evaluation on a wide variety of text generation tasks. |
| Outcome: | The proposed toolkit covers most common n-gram metrics and latest embedding-based metrics such as BERTScore. |
Multilingual Translation from Denoising Pre-Training (2021.findings-acl)
Copied to clipboard
Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, Angela Fan
| Challenge: | Recent work shows potential of training one model for multilingual machine translation . but little has been explored on the potential to combine denoising pretraining with multilingual translation in a single model. |
| Approach: | They propose to combine denoising pretraining with multilingual machine translation in a single model. |
| Outcome: | The proposed model improves over models trained from scratch and bilingually for translation into English. |
Textless Speech-to-Speech Translation on Real Data (2022.naacl-main)
Copied to clipboard
Ann Lee, Hongyu Gong, Paul-Ambroise Duquenne, Holger Schwenk, Peng-Jen Chen, Changhan Wang, Sravya Popuri, Yossi Adi, Juan Pino, Jiatao Gu, Wei-Ning Hsu
| Challenge: | Existing text-based speech-to-speech translation systems rely on cascaded approach . text-to text translation systems require text generation and a single input to generate output . |
| Approach: | They propose a textless speech-to-speech translation system that can translate speech from one language into another without the need of text data. |
| Outcome: | The proposed system can translate speech from one language into another without text data. |
Direct Speech-to-Speech Translation With Discrete Units (2022.acl-long)
Copied to clipboard
Ann Lee, Peng-Jen Chen, Changhan Wang, Jiatao Gu, Sravya Popuri, Xutai Ma, Adam Polyak, Yossi Adi, Qing He, Yun Tang, Juan Pino, Wei-Ning Hsu
| Challenge: | Existing direct speech-to-speech translation models rely on text generation as an intermediate step. |
| Approach: | They propose a direct speech-to-speech translation model that translates speech from one language to another without relying on intermediate text generation. |
| Outcome: | The proposed model produces 6.7 BLEUs in the Fisher Spanish-English dataset when trained without any text transcripts and with text supervision. |
Lightweight Adapter Tuning for Multilingual Speech Translation (2021.acl-short)
Copied to clipboard
| Challenge: | Adapter tuning is an efficient alternative to fine-tuning in NLP . a multilingual model could be outperformed by its bilingual counterparts . |
| Approach: | They propose to use adapter tuning to optimize for multilingual speech translation . they use pre-trained models to freeze pre-train parameters and inject lightweight modules . |
| Outcome: | The proposed adapters can specialize to specific language pairs with low extra cost . the proposed models outperform bilingual models on high-resource language pairs . |
CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing datasets involve language pairs with English as source language, are low resource or lack labeled data. |
| Approach: | They propose a multilingual speech-to-text translation corpus from 11 languages into English . they provide empirical evidence of the quality of the data and provide initial benchmarks . |
| Outcome: | The proposed model is the first end-to-end multilingual model for spoken language translation. |
The Source-Target Domain Mismatch Problem in Machine Translation (2021.eacl-main)
Copied to clipboard
Jiajun Shen, Peng-Jen Chen, Matthew Le, Junxian He, Jiatao Gu, Myle Ott, Michael Auli, Marc’Aurelio Ranzato
| Challenge: | Despite the interconnected world we live in, people in different places talk about different things in different parts of the world. |
| Approach: | They propose a metric to quantify the effect of local context in machine translation and propose measurable results. |
| Outcome: | The proposed metric can be used to quantify the effect of local context on the use of language in machine translation systems on low resource languages. |
Detection, Disambiguation, Re-ranking: Autoregressive Entity Linking as a Multi-Task Problem (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for entity linking do not use a knowledge base or candidate sets. |
| Approach: | They propose an autoregressive entity linking model that is trained with two auxiliary tasks and learns to re-rank generated samples at inference time. |
| Outcome: | The proposed model improves on two biomedical datasets and a news domain dataset without the use of a knowledge base or candidate sets. |
Divide-or-Conquer? Which Part Should You Distill Your LLM? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that Large Language Models (LLMs) can solve reasoning tasks better when they are encouraged to solve subtasks of the main task first. |
| Approach: | They propose a strategy that breaks down reasoning tasks into a problem decomposition phase and a solution phase and propose 'smaller' models that can achieve good generalization. |
| Outcome: | The proposed approach outperforms a single stage solution in two tasks and their impact on reasoning outcomes and inference cost. |
SIMULEVAL: An Evaluation Toolkit for Simultaneous Translation (2020.emnlp-demos)
Copied to clipboard
| Challenge: | SimulEval is an evaluation toolkit for simultaneous text and speech translation. |
| Approach: | They propose a server-client scheme for simultaneous translation that uses server input and client policies to evaluate models. |
| Outcome: | The proposed evaluation toolkit is available for both text and speech translation. |
Multilingual Neural Machine Translation with Deep Encoder and Multiple Shallow Decoders (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent work in multilingual translation has improved translation quality surpassing bilingual baselines using deep transformer models with increased capacity. |
| Approach: | They propose a deep encoder with multiple shallow decoders to reduce inference latency while maintaining translation quality. |
| Outcome: | The proposed model achieves 1.8x speedup on average compared to a standard transformer model with no drop in translation quality. |
Detecting Hallucinated Content in Conditional Neural Sequence Generation (2021.findings-acl)
Copied to clipboard
Chunting Zhou, Graham Neubig, Jiatao Gu, Mona Diab, Francisco Guzmán, Luke Zettlemoyer, Marjan Ghazvininejad
| Challenge: | Neural sequence models can generate fluent sentences, but they can also hallucinate additional content not supported by the input. |
| Approach: | They propose a task to predict whether each token in the output sequence is hallucinated and collect manually annotated evaluation sets for this task. |
| Outcome: | The proposed method outperforms baseline methods on machine translation and abstractive summarization datasets and achieves significant improvements in both supervised and unsupervised settings. |
IDPG: An Instance-Dependent Prompt Generation Method (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing prompt tuning methods use a fixed prompt in each input instance during the model training stage. |
| Approach: | They propose a conditional prompt generation method to generate prompts for each input instance. |
| Outcome: | The proposed method outperforms other prompt tuning methods while tuning fewer parameters. |
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing non-autoregressive neural machine translation models are slow to learn the dependency between output tokens. |
| Approach: | They propose to use fully non-autoregressive neural machine translation (NAT) to predict tokens with single forward of neural networks. |
| Outcome: | The proposed model achieves state-of-the-art results on three translation benchmarks with comparable performance to autoregressive and iterative NAT systems. |
Improved Zero-shot Neural Machine Translation via Ignoring Spurious Correlations (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to train a multilingual NMT model for low-resource languages are lacking in terms of number of supervised examples. |
| Approach: | They propose to use decoder pre-training and back-translation to solve the degeneracy problem by analyzing spurious correlations between source and decoded sentences. |
| Outcome: | The proposed methods show significant improvement over the pivot-based approach on three challenging multilingual datasets. |
Unified Speech-Text Pre-training for Speech Translation and Recognition (2022.acl-long)
Copied to clipboard
Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, Juan Pino
| Challenge: | Existing methods to pre-train speech and text use unlabeled data to learn universal feature representations. |
| Approach: | They propose a method to jointly pre-train speech and text in an encoder-decoder modeling framework for speech translation and recognition. |
| Outcome: | The proposed method achieves between 1.7 and 2.3 BLEU improvement above the state of the art on the MuST-C speech translation dataset and comparable WERs to wav2vec 2.0 on the Librispeech speech recognition task. |
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing models for automatic speech recognition and multilingual speech translation are on par with cascade counterparts. |
| Approach: | They propose a dual-decoder Transformer architecture that performs automatic speech recognition and multilingual speech translation. |
| Outcome: | The proposed models outperform the previously-reported highest translation performance in multilingual settings and bilingual one-to-one results. |