Challenge: a comparative study of multilingual text classification models analyzes the performance of different models based on different languages . low-resource languages are highly influenced by typology of the languages on which the models have been trained or fine-tuned but also by their size.
Approach: They compare machine and deep learning models with a dataset of epidemiological news articles . they find that the performance of the models is proportionate to the training data size .
Outcome: The proposed model outperforms baseline models on a multilingual text classification task . low-resource languages are highly influenced by typology of languages and their size .

Similar Papers

Multilingual Generation in Abstractive Summarization: A Comparative Study (2024.lrec-main)

Copied to clipboard

Challenge: Existing models for multilingual generation lack thorough analysis due to extensive linguistic diversity.
Approach: They propose to classify multilingual generation methodologies into three categories based on their underlying modeling principles . they introduce an automatic metric to mitigate spurious correlations associated with language mixing .
Outcome: The proposed model improves in high-resource, low-resourced, and zero-shot scenarios.
Multilingual and cross-lingual document classification: A meta-learning approach (2021.eacl-main)

Copied to clipboard

Challenge: Existing methods to document classification in low-resource languages are under-resourced . 6% of the world's languages are spoken, and many have inadequate resources .
Approach: They propose a meta-learning approach to document classification in low-resource languages . they propose 'nuclear-shot' cross-lingual adaptation to previously unseen languages based on limited data .
Outcome: The proposed method performs on-par on some languages while under-resourced in others.
Social Bias in Multilingual Language Models: A Survey (2025.emnlp-main)

Copied to clipboard

Challenge: Pretrained multilingual models exhibit the same social bias as models processing English texts.
Approach: They examine the literature on bias evaluation and mitigation approaches in multilingual and non-English contexts and identify gaps in the field.
Outcome: The proposed models perform well on multilingual language understanding benchmarks and are consistent with the current literature.
MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media Texts (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for detecting social-media texts are limited to the English language and longer texts are not easily recognisable by humans.
Approach: They propose to use a multilingual and multi-platform dataset to compare machine-generated text detection methods in the social-media domain to compare them to human-written texts.
Outcome: The proposed dataset contains 472,097 texts, of which about 58k are human-written and approximately the same amount is generated by each of 7 multilingual LLMs.
Language Models for Text Classification: Is In-Context Learning Enough? (2024.lrec-main)

Copied to clipboard

Challenge: Existing research on text classification models with prompts is limited in scale and lacks understanding of how these methods compare to more established methods.
Approach: They compare the performance of large and smaller language models with prompts to achieve state-of-the-art performance in many NLP tasks.
Outcome: The proposed models outperform the more standard approaches in binary, multiclass, and multilabel tasks in a large scale evaluation of 16 text classification datasets.
Practical Transformer-based Multilingual Text Classification (2021.naacl-industry)

Copied to clipboard

Challenge: XNLI does not reflect the data availability and task variety of industry applications.
Approach: They compare transformer-based text classification methods to multilingual models in five different languages . they use a task- and domain-adaptive pretraining and data augmentation technique .
Outcome: The proposed methods outperform monolingual models on two tasks in five languages . the results show that practical modifications can improve model performance without labeling .
Small Language Models Are Good Too: An Empirical Study of Zero-Shot Classification (2024.lrec-main)

Copied to clipboard

Challenge: Using small language models, we challenge the dominance of large models in text classification by prompting.
Approach: They compare the performance of small and large language models in a zero-shot context using different architectures and scoring functions.
Outcome: The proposed model outperforms large models in a zero-shot context.
T3L: Translate-and-Test Transfer Learning for Cross-Lingual Text Classification (2023.tacl-1)

Copied to clipboard

Challenge: Existing approaches to cross-lingual text classification leverage text classifiers trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning.
Approach: They propose to combine a neural machine translator and a text classifier trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning.
Outcome: The proposed approach significantly improves over a baseline approach.
Safety of Large Language Models Beyond English: A Systematic Literature Review of Risks, Biases, and Safeguards (2026.eacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have a growing number of applications that generate harmful, biased, or unsafe content.
Approach: They synthesize findings from recent studies that evaluate their robustness across languages . they highlight gaps in multilingual safety research and recommend future work .
Outcome: The systematic review examines the multilingual safety of large language models in English . it identifies challenges such as dataset availability and evaluation biases .
Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan (2021.findings-acl)

Copied to clipboard

Challenge: Multilingual language models have been a crucial breakthrough for under-resourced languages . however, the superiority of language-specific models has already been proven for underresourced ones .
Approach: They propose to build a monolingual monolingual model that is comparable to state-of-the-art large multilingual models.
Outcome: The proposed model consistently outperforms state-of-the-art models across tasks and settings.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations