Challenge: Pretrained language models have shown remarkable generalization toward multiple tasks and languages, but their generalization towards unseen languages is poor.
Approach: They propose a regularization technique that incorporates various aspects of languages to better characterize linguistics constraints.
Outcome: The proposed technique improves accuracy of mBERT and XLM-R on unseen languages by 18% and 2% compared to fully finetuned models.

Similar Papers

Evaluating Large Language Models along Dimensions of Language Variation: A Systematik Invesdigatiom uv Cross-lingual Generalization (2024.emnlp-main)

Copied to clipboard

Challenge: Xue et al., 2021) show that large language models suffer from performance degradation on unseen closely-related languages and dialects relative to their high-resource language neighbour (HRLN).
Approach: They propose to model phonological, morphological, and lexical distance as Bayesian noise processes to synthesize artificial languages that are controllably distant from the HRLN.
Outcome: The proposed model offers insights on model robustness to isolated and composed linguistic phenomena and the impact of task and HRL characteristics on PD.
Massively Multilingual Lexical Specialization of Multilingual Transformers (2023.acl-long)

Copied to clipboard

Challenge: Existing work focused on lexical specialization of monolingual PLMs with immense quantities of monolinguistic constraints, but recent work shows that pretrained language models can be rewired to produce high-quality word representations and perform type-level lexicals.
Approach: They propose to expose massively multilingual transformers to multilingual lexical knowledge at scale using BabelNet as a source of multilingual and cross-lingual type-level lexicon knowledge.
Outcome: The proposed method shows that pretrained language models can be rewired to produce high-quality word representations and perform type-level lexical tasks.
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation (2022.acl-long)

Copied to clipboard

Challenge: Recent studies have found that the performance of multilingual pretrained models is highly dependent on the availability of monolingual or parallel text in a target language.
Approach: They propose to use bilingual lexicons to synthesize textual or labeled data and combine it with monolingual or parallel text when available.
Outcome: The proposed methods improve performance for 19 under-represented languages with and without extra monolingual text.
On the Relation between Linguistic Typology and (Limitations of) Multilingual Language Modeling (D18-1)

Copied to clipboard

Challenge: a key challenge in cross-lingual NLP is developing general language-independent architectures that are equally applicable to any language.
Approach: They propose to use a full-vocabulary setup to test the performance of language modeling (LM) on 50 typologically diverse languages.
Outcome: The proposed language modeling task is based on a full vocabulary setup focused on word-level prediction on 50 typologically diverse languages.
Data and Model Centric Approaches for Expansion of Large Language Models to New languages (2025.emnlp-tutorials)

Copied to clipboard

Challenge: Existing LLMs mainly support English alongside a handful of high resource languages . this leaves a major gap for most low-resource languages despite increasing pace of research .
Approach: This tutorial examines approaches to expand the language coverage of LLMs . they look at tokenizer training, pre-training, instruction tuning, alignment, evaluation, etc.
Outcome: This tutorial examines approaches to expand the language coverage of LLMs . it provides an efficient and viable path to bring LLM technologies to low-resource languages .
MoNoise: A Multi-lingual and Easy-to-use Lexical Normalization Tool (P19-3)

Copied to clipboard

Challenge: In this paper, we demonstrate the online demo and command line interface of a lexical normalization system (MoNoise) for a variety of languages.
Approach: They propose to bundle seven datasets in six languages to form a new benchmark and a novel evaluation metric which is particularly suitable for cross-dataset comparisons.
Outcome: The proposed model is based on the original word and features from the original language for each normalization candidate.
On Evaluating Multilingual Compositional Generalization with Translated Datasets (2023.acl-long)

Copied to clipboard

Challenge: a growing amount of research investigating compositional generalization in NLP is done on English . a critical semantic distortion is a limitation of the translation of datasets .
Approach: They propose to translate a dataset for evaluating compositional generalization in semantic parsing.
Outcome: The proposed benchmarks show that the translation of the MCWQ dataset suffers from semantic distortion.
Probing Pretrained Language Models for Lexical Semantics (2020.emnlp-main)

Copied to clipboard

Challenge: Existing studies have focused on morphosyntactic, semantic, and world knowledge, but it remains unclear to what extent LMs derive lexical type-level knowledge from words in context.
Approach: They propose to use multilingual and monolingual LMs to extract lexical type-level knowledge from words in context.
Outcome: The proposed models perform well across six typologically diverse languages and five lexical tasks.
Empowering Low-Resource Regional Languages with Lexicons : A Comparative Study of NLP Tools for Morphosyntactic Analysis (2024.lrec-main)

Copied to clipboard

Challenge: a lack of human and financial resources makes integrating lexicon information to low-resource languages challenging.
Approach: They propose to use a bilingual lexicon to integrate lexical information to low-resource language . they compare a lexiconal approach to a neural approach that uses a larger lexicone .
Outcome: The proposed approach improves POS tagging while using different lexicon sizes.
Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guide (2026.tacl-1)

Copied to clipboard

Challenge: Pre-trained language models provide strong foundations, but effective adaptation under data scarcity requires efficient and efficient fine-tuning techniques.
Approach: They propose to review parameter-efficient fine-tuning techniques that lower training and deployment costs and domain and cross-lingual adaptation methods for both encoder and decoder models.
Outcome: The proposed techniques lower training and deployment costs, domain and cross-lingual adaptation methods, and model specialization strategies.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations