How Lexical is Bilingual Lexicon Induction? (2024.findings-naacl)

Copied to clipboard

Challenge: lexical variation and low-resource settings make it difficult to learn in low-level settings.
Approach: They propose to incorporate additional lexical information into the retrieve-and-rank approach to improve lexicon induction.
Outcome: The proposed approach improves on XLING by an average of 2% across all language pairs.

Similar Papers

Improving Bilingual Lexicon Induction with Cross-Encoder Reranking (2022.findings-emnlp)

Copied to clipboard

Challenge: Current methods for bilingual lexicon induction rely on the induction of cross-lingual word embeddings (CLWEs) such as VecMap or mPLMs are not available for multilingual NLP.
Approach: They propose a semi-supervised post-hoc reranking method which combines cross-lingual lexical knowledge from multilingual pretrained language models with original CLWEs.
Outcome: The proposed method outperforms existing methods on two standard benchmarks spanning a wide spectrum of languages and is robust to different CLWEs.
Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignment (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for bilingual lexicon induction are linear and require simplifying assumptions.
Approach: They propose methods that combine unsupervised bitext mining and unsupervised word alignment to produce higher quality lexicons.
Outcome: The proposed method outperforms the state-of-the-art on the BUCC 2020 task by 14 F1 points . further analysis suggests they are comparable quality .
Orthographic Features for Bilingual Lexicon Induction (P18-2)

Copied to clipboard

Challenge: Recent embedding-based methods do not take advantage of orthographic features, such as edit distance, which can be helpful for pairs of related languages.
Approach: They propose to use orthographic features to integrate orthographic induction into embedding methods . they use document-aligned data instead of a seed dictionary to learn bilingual embedds .
Outcome: This work extends embedding-based methods to incorporate orthographic features . it shows that the methods can learn bilingual embeddables in low-resource languages .
Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Induction (2021.findings-acl)

Copied to clipboard

Challenge: Bilingual Lexicon Induction (BLI) aims to map words in one language to their translations in another.
Approach: They propose a mechanism to combine static word embeddings and contextual representations to utilize the advantages of both paradigms.
Outcome: The proposed method improves performance on supervised and unsupervised BLI benchmarks on all language pairs by average improving 3.2 points over baselines.
On Bilingual Lexicon Induction with Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to induction bilingual lexicons still require cross-lingual word representations . a recent study shows that few-shot prompting with in-context examples from nearest neighbours achieves the best performance .
Approach: They examine whether it is possible to prompt and fine-tune multilingual LLMs for BLI . they experiment with 18 open-source text-to-text mLLMs of different sizes .
Outcome: The proposed approach is compared with existing approaches on two standard BLI benchmarks covering a range of typologically diverse languages.
LNMap: Departures from Isomorphic Assumption in Bilingual Lexicon Induction Through Non-Linear Mapping in Latent Space (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for bilingual lexicon induction are mapping-based, but they do not hold for closely related languages.
Approach: They propose a semi-supervised method to learn cross-lingual word embeddings for BLI using a linear mapping function and a latent space of two independently trained autoencoders.
Outcome: The proposed method outperforms existing models on 15 different language pairs on both directions.
Bilingual Lexicon Induction through Unsupervised Machine Translation (P19-1)

Copied to clipboard

Challenge: Existing methods for bilingual lexicon induction use nearest neighbor or related retrieval methods to induce word translation pairs.
Approach: They propose a method that aligns word embeddings in two languages and uses them to build a phrase-table and a language model to extract the bilingual lexicon.
Outcome: The proposed method improves accuracy 6 points over nearest neighbor and 4 points over CSLS retrieval on the same cross-lingual embeddings.
DM-BLI: Dynamic Multiple Subspaces Alignment for Unsupervised Bilingual Lexicon Induction (2024.acl-long)

Copied to clipboard

Challenge: Existing approaches to unsupervised bilingual lexicon induction (BLI) fail on distant or low-resource language pairs, achieving less than half the performance observed in rich-resourced languages.
Approach: They propose a framework for unsupervised bilingual lexicon induction that uses multiple subspace alignments instead of a single mapping.
Outcome: Experiments on 12 language pairs show that the proposed framework improves language alignment by utilizing multiple subspace alignments instead of a single mapping.
A Discriminative Latent-Variable Model for Bilingual Lexicon Induction (D18-1)

Copied to clipboard

Challenge: Existing methods for bilingual lexicon induction take advantage of word embeddings, but our model is not as efficient as previous work.
Approach: They propose a discriminative latent-variable model for bilingual lexicon induction that combines the bipartite matching dictionary prior and an embedding-based approach.
Outcome: The proposed model outperforms existing models on six language pairs and shows that it mitigates hubness problem.
When Your Cousin Has the Right Connections: Unsupervised Bilingual Lexicon Induction for Related Data-Imbalanced Languages (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for unsupervised bilingual lexicon induction depend on good quality static or contextual embeddings for both languages.
Approach: They propose a method for unsupervised bilingual lexicon induction between a related LRL and a high-resource language that only requires inference on a masked language model of the HRL.
Outcome: The proposed method performs well on low-resource languages with 5M tokens against Hindi . it is compared with existing methods on (mid-resourced) Marathi and Nepali .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations