Challenge: Existing models for automatic dialect classification use bag-of-words unigram features instead of linguistic knowledge.
Approach: They propose to use dialect-specific unigram features to train machine learning models . they also use a transformer-based model to find potentially useful dialect-related features .
Outcome: The proposed model outperforms existing models but sacrifices explainability and interpretability.

Similar Papers

Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers (2024.naacl-short)

Copied to clipboard

Challenge: Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis.
Approach: They propose a method to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers in the absence of human experts.
Outcome: The proposed method extracts key language-specific lexical features that contribute to dialectal variations.
Quantifying the Dialect Gap and its Correlates Across Languages (2023.findings-emnlp)

Copied to clipboard

Challenge: Historically, studies investigating minority variants of languages have been limited to a select few languages.
Approach: They evaluate state-of-the-art large language models for regional dialects of several high- and low-resource languages and analyze how regional dialect gap is correlated with economic, social, and linguistic factors.
Outcome: The proposed model is compared with two high-use applications and shows that it can solve the regional dialect gap.
Do BERT-Like Bidirectional Models Still Perform Better on Text Classification in the Era of LLMs? (2025.findings-emnlp)

Copied to clipboard

Challenge: Rapid adoption of LLMs has overshadowed the potential advantages of traditional BERT-like models in text classification.
Approach: They compare BERT-like models fine-tuning, LLM internal state utilization, and LLM zero-shot inference across six datasets.
Outcome: The proposed method outperforms LLMs on six challenging datasets.
What’s so special about BERT’s layers? A closer look at the NLP pipeline in monolingual and multilingual models (2020.findings-emnlp)

Copied to clipboard

Challenge: In addition, information on part-of-speech tagging is spread over different parts of the network and the pipeline might not be as neat as it seems.
Approach: They propose to probe Dutch BERT-based model and multilingual BERT model for Dutch NLP tasks to see if this holds true for other languages.
Outcome: The proposed model is based on a Dutch model and a multilingual model for Dutch NLP tasks.
Elote, Choclo and Mazorca: on the Varieties of Spanish (2024.naacl-long)

Copied to clipboard

Challenge: Spanish is the official language in 20 countries and the second most-spoken native language . available corpora treat it as one monolithic language, damping prediction power .
Approach: They compile and curate datasets in different varieties of Spanish around the world at an unprecedented scale and create the CEREAL corpus.
Outcome: The results show that Spanish is a multilingual language with a wide range of cultural and cultural influences.
Comparing Feature-Engineering and Feature-Learning Approaches for Multilingual Translationese Classification (2021.emnlp-main)

Copied to clipboard

Challenge: Traditional hand-crafted features have been used for distinguishing between translated and original non-translated texts.
Approach: They compare a feature-engineering-based approach to a features-learning-based one and use pre-trained neural word embeddings to train neural architectures.
Outcome: The proposed approach outperforms other approaches by more than 20 accuracy points and the BERT-based model performs the best in both monolingual and multilingual settings.
What BERT Is Not: Lessons from a New Suite of Psycholinguistic Diagnostics for Language Models (2020.tacl-1)

Copied to clipboard

Challenge: Pretraining by language modeling has become popular but we have yet to understand what language models learn during that process.
Approach: They propose diagnostics that ask questions about information used by language models for generating predictions in context.
Outcome: The proposed diagnostics can be used to study the popular BERT model . they show that the model can distinguish good from bad completions, but struggles with inference and role-based event prediction.
Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan (2021.findings-acl)

Copied to clipboard

Challenge: Multilingual language models have been a crucial breakthrough for under-resourced languages . however, the superiority of language-specific models has already been proven for underresourced ones .
Approach: They propose to build a monolingual monolingual model that is comparable to state-of-the-art large multilingual models.
Outcome: The proposed model consistently outperforms state-of-the-art models across tasks and settings.
Can Monolingual Pretrained Models Help Cross-Lingual Classification? (2020.aacl-main)

Copied to clipboard

Challenge: Multilingual pretrained language models have shown impressive results for cross-lingual transfer, but due to the constant model capacity, multilingual pre-training usually lags behind the monolingual competitors.
Approach: They propose to transfer the knowledge from monolingual pretrained models to multilingual ones to improve zero-shot cross-lingual classification by using machine translation systems.
Outcome: The proposed methods outperform vanilla multilingual fine-tuning on two cross-lingual classification benchmarks.
Learning to Recognize Dialect Features (2021.naacl-main)

Copied to clipboard

Challenge: linguistics do not characterize dialects as simple categories, but as collections of correlated features.
Approach: They propose two multitask learning approaches based on pretrained transformers to detect dialect features in speech and text.
Outcome: The proposed models learn to recognize many features with high accuracy on 22 dialect features of Indian English.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations