Don’t Forget the Long Tail! A Comprehensive Analysis of Morphological Generalization in Bilingual Lexicon Induction (D19-1)
Copied to clipboard
| Challenge: | Human translators have to translate rare inflections due to Zipfian distribution of words in a language. |
| Approach: | They introduce 40 morphologically complete dictionaries in 10 languages and evaluate three of the best performing models on the task of translation of less frequent morphology. |
| Outcome: | The proposed models perform better on infrequent morphological inflections and add a simple constraint at training time. |
Similar Papers
Morphologically Aware Word-Level Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Current approaches to bilingual lexicon induction (BLI) ignore inflectional morphology . current models degrade when translating less frequent inflected forms . |
| Approach: | They propose a morphologically aware probability model that models lexeme translation and inflectional morphology in a structured way. |
| Outcome: | The proposed model improves performance across 6 language pairs and in the weakly supervised setting. |
Morphological Inflection: A Reality Check (2023.acl-long)
Copied to clipboard
| Challenge: | Morphological inflection is a popular task in sub-word NLP with practical and cognitive applications. |
| Approach: | They propose new methods to analyze data sets and evaluate their generalization abilities to better reflect likely use-cases. |
| Outcome: | The proposed methods improve generalizability and reliability of results and improve generalization abilities. |
How Lexical is Bilingual Lexicon Induction? (2024.findings-naacl)
Copied to clipboard
| Challenge: | lexical variation and low-resource settings make it difficult to learn in low-level settings. |
| Approach: | They propose to incorporate additional lexical information into the retrieve-and-rank approach to improve lexicon induction. |
| Outcome: | The proposed approach improves on XLING by an average of 2% across all language pairs. |
Evaluating bilingual word embeddings on the long tail (N18-2)
Copied to clipboard
| Challenge: | Bilingual word embeddings are useful for bilingual lexicon induction, but they focus on frequent words in general domains. |
| Approach: | They propose to evaluate bilingual word embeddings on rare words in different domains . they propose to use a multilingual dataset to build and combine BWEs based on a single word . |
| Outcome: | The proposed evaluations show that state-of-the-art methods fail on rare words . the proposed evaluation is based on a gold standard dataset and code . |
Orthographic Features for Bilingual Lexicon Induction (P18-2)
Copied to clipboard
| Challenge: | Recent embedding-based methods do not take advantage of orthographic features, such as edit distance, which can be helpful for pairs of related languages. |
| Approach: | They propose to use orthographic features to integrate orthographic induction into embedding methods . they use document-aligned data instead of a seed dictionary to learn bilingual embedds . |
| Outcome: | This work extends embedding-based methods to incorporate orthographic features . it shows that the methods can learn bilingual embeddables in low-resource languages . |
Exploring Linguistic Probes for Morphological Inflection (2023.emnlp-main)
Copied to clipboard
| Challenge: | morphological inflection models typically employ language-independent data splitting algorithms. |
| Approach: | They propose language-specific probes to test aspects of morphological generalization . they use three morphology-distinct languages to test their generalization abilities . |
| Outcome: | The proposed language-specific probes are used to test morphological generalization abilities on three distinct languages. |
GATITOS: Using a New Multilingual Lexicon for Low-resource Machine Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | a new study explores the effectiveness of bilingual lexica in machine translation models . cross-lingual vocabulary alignment is still highly imperfect in these models, despite the success of supervised and self-supervised training. |
| Approach: | They use a resource to improve translation performance on 200-language models . they show that lexica is more reliable than human-translated data . |
| Outcome: | The proposed approach improves on 200-language translation models with lexical data augmentation . the proposed approach is open-source and has 168 tail languages . |
On the Limitations of Unsupervised Bilingual Dictionary Induction (P18-1)
Copied to clipboard
| Challenge: | Unsupervised machine translation does not require cross-lingual supervision, whether a dictionary, translations, or comparable corpora. |
| Approach: | They propose an adversarial, unsupervised cross-lingual word embedding technique for bilingual dictionary induction that exploits a weak supervision signal from identical words. |
| Outcome: | The proposed model relies heavily on an adversarial, unsupervised cross-lingual word embedding technique for bilingual dictionary induction. |
A Discriminative Latent-Variable Model for Bilingual Lexicon Induction (D18-1)
Copied to clipboard
| Challenge: | Existing methods for bilingual lexicon induction take advantage of word embeddings, but our model is not as efficient as previous work. |
| Approach: | They propose a discriminative latent-variable model for bilingual lexicon induction that combines the bipartite matching dictionary prior and an embedding-based approach. |
| Outcome: | The proposed model outperforms existing models on six language pairs and shows that it mitigates hubness problem. |
Morphology Without Borders: Clause-Level Morphology (2022.tacl-1)
Copied to clipboard
| Challenge: | Morphological tasks use large multi-lingual datasets that organize words into inflection tables . lack of a clear linguistic and operational definition of what is a word impairs universality of tasks . |
| Approach: | They propose to view morphology as a clause-level phenomenon, rather than word-level . they propose to use a dataset for clause- level morphological tasks in 4 different languages . |
| Outcome: | The proposed dataset for clause-level morphology covers 4 typologically different languages: English, German, Turkish, and Hebrew. |