| Challenge: | a new study investigates the impact of anaphoric one words in English on the neural machine translation process. |
| Approach: | They investigate the impact of anaphoric one words in English on the Neural Machine Translation process using English-Hindi as source and target language pair. |
| Outcome: | The proposed system performs poorly on sentences containing anaphoric ones compared to sentences involving regular, non-anaphorical ones . the results show that amongst the anamorphic words, the noun class is clearly much harder for NMT than the determinatives . |
Similar Papers
Linguistically Informed Hindi-English Neural Machine Translation (2020.lrec-1)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) is a promising approach to machine translation . lack of parallel training data for Hindi-English is limiting . |
| Approach: | They propose to incorporate linguistic knowledge encoded by Hindi phenomena into a Transformer model to improve the translation performance. |
| Outcome: | The proposed model incorporates linguistic features to improve the translation performance. |
Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT (2021.emnlp-main)
Copied to clipboard
| Challenge: | Statistical MT decomposes the translation task into distinct components that are learned separately. |
| Approach: | They show that neural machine translation models acquire different competences over the course of training . previous work shows how to improve some of the competences in NMT by using lexical translation probabilities, phrase memories, alignment information. |
| Outcome: | The proposed model improves translation quality and word-by-word translation, while learning complex reordering patterns. |
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads? (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent studies on multilingual representations focus on whether there is an emergence of language-independent representations or whether multilingual models partition their weights among different languages. |
| Approach: | They analyze encoder self-attention and encoder-decoder attention heads in a multilingual neural translation model. |
| Outcome: | The proposed model is based on a multilingual neural translation model with a language-independent representation. |
When do Contrastive Word Alignments Improve Many-to-many Neural Machine Translation? (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to improve pre-training for many-to-many neural machine translation use manual cleaning of bilingual dictionaries, which are unavailable for most language pairs. |
| Approach: | They propose a word-level contrastive objective to leverage word alignments for many-to-many neural machine translation (NMT) Empirical results show that this leads to 0.8 BLEU gains for several language pairs. |
| Outcome: | Empirical results show that the proposed objective leads to 0.8 BLEU gains for several language pairs. |
Bridging the Gap between Training and Inference for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural Machine Translation generates target words sequentially while at inference it has to generate the entire sequence from scratch. |
| Approach: | They propose to use ground truth and inference to generate target words sequentially while at inference it has to generate the entire sequence from scratch. |
| Outcome: | Experiments on Chinese->English and WMT’14 English->German translation tasks show that the proposed model can achieve significant improvements on multiple datasets. |
Addressing word-order Divergence in Multilingual Neural Machine Translation for extremely Low Resource Languages (N19-1)
Copied to clipboard
| Challenge: | Existing studies show that transfer learning works best when the languages are related. |
| Approach: | They propose to pre-order assisting language sentences to match the word order of the source language and train the parent model. |
| Outcome: | The proposed model can improve translation quality in low-resource scenarios by pre-ordering the assisting language sentences to match the word order of the source language and training the parent model. |
Machine Translation for Machines: the Sentiment Classification Use Case (D19-1)
Copied to clipboard
| Challenge: | Traditionally, machine translation (MT) pursues a "human-oriented" objective: generating fluent output for a downstream task. |
| Approach: | They propose a neural machine translation approach that uses weak feedback to generate translations that are best suited for a downstream task. |
| Outcome: | The proposed approach outperforms general-purpose models and reinforcement learning methods on German and Italian tweets. |
Revisiting Negation in Neural Machine Translation (2021.tacl-1)
Copied to clipboard
| Challenge: | Negation is an important linguistic phenomenon in machine translation, as errors in translating negation may change the meaning of source sentences completely. |
| Approach: | They evaluate the translation of negation in English–German (EN–DE) and English– Chinese (EN-ZH) . they find that NMT models can distinguish negation and non-negation tokens very well and encode a lot of information about negation . |
| Outcome: | The accuracy of manual evaluation in ENDE, DEEN, ENZH, and ZHEN is 95.7%, 94.8%, 93.4%, and 91.7% respectively. |
Target Conditioned Sampling: Optimizing Data Selection for Multilingual Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Existing studies show that training on a single related language is more effective than using all data. |
| Approach: | They propose an efficient algorithm that first samples a target sentence, and then conditionally samples its source sentence. |
| Outcome: | The proposed algorithm brings significant gains on three of four languages with minimal training overhead. |
English-Indonesian Neural Machine Translation for Spoken Language Domains (P19-2)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a data-driven method that requires a large amount of data to build a robust model. |
| Approach: | They conduct a study on Neural Machine Translation (NMT) for English-Indonesian and Indonesian-English (ID-EN) they build NMT systems using the Transformer model for both translation directions and implement domain adaptation method to train pre-trained NMT on speech language data. |
| Outcome: | The proposed model can learn formal translation outputs for English-Indonesian and Indonesian-English (ID-EN) given a small dataset of speech-styled language and a larger dataset of less formal language, the proposed model will be useful for learning formality level. |