Challenge: Existing methods to incorporate bilingual lexicons into statistical machine translation are unclear how to do so in the neural framework.
Approach: They present a dataset to test methods for bilingual lexicon integration into neural machine translation using human generated alignments of words and phrases in three language pairs.
Outcome: The proposed method improves on baselines and improves training to address overfitting.

Similar Papers

Bilingual Lexicon Induction through Unsupervised Machine Translation (P19-1)

Copied to clipboard

Challenge: Existing methods for bilingual lexicon induction use nearest neighbor or related retrieval methods to induce word translation pairs.
Approach: They propose a method that aligns word embeddings in two languages and uses them to build a phrase-table and a language model to extract the bilingual lexicon.
Outcome: The proposed method improves accuracy 6 points over nearest neighbor and 4 points over CSLS retrieval on the same cross-lingual embeddings.
GATITOS: Using a New Multilingual Lexicon for Low-resource Machine Translation (2023.emnlp-main)

Copied to clipboard

Challenge: a new study explores the effectiveness of bilingual lexica in machine translation models . cross-lingual vocabulary alignment is still highly imperfect in these models, despite the success of supervised and self-supervised training.
Approach: They use a resource to improve translation performance on 200-language models . they show that lexica is more reliable than human-translated data .
Outcome: The proposed approach improves on 200-language translation models with lexical data augmentation . the proposed approach is open-source and has 168 tail languages .
Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignment (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for bilingual lexicon induction are linear and require simplifying assumptions.
Approach: They propose methods that combine unsupervised bitext mining and unsupervised word alignment to produce higher quality lexicons.
Outcome: The proposed method outperforms the state-of-the-art on the BUCC 2020 task by 14 F1 points . further analysis suggests they are comparable quality .
Neural Machine Translation for Bilingually Scarce Scenarios: a Deep Multi-Task Learning Approach (N18-1)

Copied to clipboard

Challenge: Neural machine translation requires large amount of parallel training text to learn a reasonable quality translation model.
Approach: They propose a multi-task learning approach that leverages monolingual linguistic resources in the source side of a machine translation task.
Outcome: The proposed approach is effective on three translation tasks: English-to-French, English- to-Farsi, and English-à-Vietnamese.
How Lexical is Bilingual Lexicon Induction? (2024.findings-naacl)

Copied to clipboard

Challenge: lexical variation and low-resource settings make it difficult to learn in low-level settings.
Approach: They propose to incorporate additional lexical information into the retrieve-and-rank approach to improve lexicon induction.
Outcome: The proposed approach improves on XLING by an average of 2% across all language pairs.
Improving Low-Resource Machine Translation for Formosan Languages Using Bilingual Lexical Resources (2024.findings-acl)

Copied to clipboard

Challenge: Using bilingual lexicons for low-resource languages can improve machine translation for low resource languages.
Approach: They propose to use bilingual lexicons to improve machine translation for low-resource languages . they use parallel data and bilingual dictionaries to generate pseudo-parallel sentences .
Outcome: The proposed techniques improve translation between Mandarin and Formosan languages and Spanish and Nahuatl, a language pair consisting of languages from completely different language families.
Continuous Learning in Neural Machine Translation using Bilingual Dictionaries (2021.eacl-main)

Copied to clipboard

Challenge: Recent advances in neural machine translation have led to astonishing translation quality of research systems.
Approach: They propose to integrate one-shot learning methods with different word representations to assess the ability of neural machine translation to continuously learn new phrases.
Outcome: The proposed framework improves translation quality of bilingual dictionaries from 30% to 70%.
End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languages (2021.acl-long)

Copied to clipboard

Challenge: Existing approaches to enforce word forms in translations struggle to make them agree with the rest of the output.
Approach: They propose to train neural machine translation models with lemmatized constraints to infer correct word inflection.
Outcome: The proposed model reduces errors in translation of constrained terms in automatic and manual evaluations on English-Czech language pairs.
Improving Lexical Choice in Neural Machine Translation (N18-1)

Copied to clipboard

Challenge: False positives: the output layer rewards frequent words disproportionately, we argue . Falsibles: a model that learns word representations in continuous space tends to translate rare words .
Approach: They propose to fix the norms of both vectors to a constant value and integrate a lexical module which is jointly trained with the rest of the model.
Outcome: The proposed approach achieves improvements of up to +4.3 BLEU surpassing phrase-based translation in nearly all settings.
From Isolates to Families: Using Neural Networks for Automated Language Affiliation (2025.acl-long)

Copied to clipboard

Challenge: linguistic affiliation of languages to a common language family is traditionally carried out manually . large-scale standardized collections of multilingual wordlists and grammatical language structures could improve this .
Approach: They propose to use lexical and grammatical data to classify languages into families using neural network models.
Outcome: The proposed models outperform models trained on lexical and grammatical data while combining both types of data yields even better performance.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations