Challenge: Lexical borrowing is a ubiquitous linguistic phenomenon influenced by geopolitical, societal, and technological factors.
Approach: They propose a novel contrastive dataset comprising sentences with and without loanwords across 10 languages to examine how machine translation and language models process loanword .
Outcome: The proposed dataset shows that state-of-the-art models prefer loanwords over native terms and exhibit varying performance across languages.

Similar Papers

A Generalized Method for Automated Multilingual Loanword Detection (2022.coling-1)

Copied to clipboard

Challenge: Loanwords are words incorporated from one language into another without translation . authors present a method to automatically detect loanwords across language pairs .
Approach: They propose a method to automatically detect loanwords across language pairs . they incorporate edit distance, semantic similarity measures, phonetic alignment .
Outcome: The proposed method outperforms existing methods on single-pair loanword detection tasks and can generalize to unseen language pairs with sufficient data.
Leveraging Loanword Constraints for Improving Machine Translation in a Low-Resource Multilingual Context (2025.emnlp-main)

Copied to clipboard

Challenge: a recent study addresses the challenge of adapting loanwords during the translation process in low-resource languages.
Approach: They propose a method that augments source sentences with loanword constraints . they then integrate loanwords as external linguistic knowledge into machine translation systems .
Outcome: The proposed approach improves translation quality and handling loanword adaptation correctly in target languages.
Contrastive Data and Learning for Natural Language Processing (2022.naacl-tutorials)

Copied to clipboard

Challenge: Current NLP models heavily rely on effective representation learning algorithms.
Approach: This tutorial introduces contrastive learning and provides an introduction to the techniques.
Outcome: This tutorial provides an introduction to the fundamentals of contrastive learning approaches and the theory behind them.
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation (2022.acl-long)

Copied to clipboard

Challenge: Recent studies have found that the performance of multilingual pretrained models is highly dependent on the availability of monolingual or parallel text in a target language.
Approach: They propose to use bilingual lexicons to synthesize textual or labeled data and combine it with monolingual or parallel text when available.
Outcome: The proposed methods improve performance for 19 under-represented languages with and without extra monolingual text.
Multilingual Culture-Independent Word Analogy Datasets (2020.lrec-1)

Copied to clipboard

Challenge: In text processing, deep neural networks use word embeddings as an input.
Approach: They propose to use benchmark datasets to compare the quality of word embeddings in text processing . they use a word analogy task in Croatian, English, Estonian, Finnish, Latvian, Lithuanian, Russian, Slovenian, and Swedish .
Outcome: The proposed datasets are culturally independent and cross-lingual for the languages used.
A Multilingual Dataset for Evaluating Parallel Sentence Extraction from Comparable Corpora (L18-1)

Copied to clipboard

Challenge: BUCC Shared Task aims to extract parallel sentences from comparable corporad . resulting corpus contains about 3.5 million distinct sentences in english, french, german, Russian, and Chinese .
Approach: They present challenges faced to build a parallel sentences dataset from comparable corporad . they emphasize issues faced to include Chinese as one of the languages .
Outcome: The 2017 BUCC Shared Task was a first for this task . the dataset contains 3.5 million sentences in English, French, German, Russian, and Chinese .
KIT-Multi: A Translation-Oriented Multilingual Embedding Corpus (L18-1)

Copied to clipboard

Challenge: Cross-lingual word embeddings are representations of words across languages in a shared continuous vector space.
Approach: They propose a multilingual word embedding corpus which is acquired by neural machine translation and is based on monolingual data.
Outcome: The proposed method is competitive with existing methods but on the cross-lingual document classification task, it obtains the best figures.
Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing work on colexification patterns relies on annotated word lists, limiting scalability and usefulness in NLP.
Approach: They propose two methods to train multilingual graphs from colexification patterns using an unannotated parallel corpus.
Outcome: The proposed methods achieve high recall on CLICS and transfer learning in multilingual graphs.
Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval (2023.acl-long)

Copied to clipboard

Challenge: Contrastive learning is the dominant paradigm for learning text representations from parallel text, but finding negative examples can be expensive in terms of compute or manual effort.
Approach: They propose a generative model for learning multilingual text embeddings which encourages source separation in multilingual contexts by an approximation.
Outcome: The proposed model outperforms both a strong contrastive and generative baseline on a suite of tasks including semantic similarity, bitext mining, and cross-lingual question retrieval.
MultiLexBATS: Multilingual Dataset of Lexical Semantic Relations (2024.lrec-main)

Copied to clipboard

Challenge: Prior work has focused on analysing lexical semantic relations in word embeddings or probing pretrained language models (PLMs) with some exceptions.
Approach: They propose to use a multilingual parallel dataset of lexical semantic relations adapted from BATS in 15 languages including low-resource languages such as Bambara, Lithuanian, and Albanian as an experiment on cross-lingual transfer of relational knowledge.
Outcome: The proposed dataset is adapted from a BATS-based dataset in 15 languages including low-resource languages such as Bambara, Lithuanian, and Albanian.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations