| Challenge: | Existing work on dialectal English NLP is task-specific, using manual annotated dialect data, weak supervision, or data augmentation. |
| Approach: | They propose a method for task-agnostic dialect adaptation by aligning non-SAE dialects with task-specific adapters from SAE. |
| Outcome: | The proposed method improves dialectal robustness on 4 dialectal variants of the GLUE benchmark without task-specific supervision. |
Similar Papers
Task-Agnostic Low-Rank Adapters for Unseen English Dialects (2023.emnlp-main)
Copied to clipboard
| Challenge: | a recent study found that LLMs are trained on corpora disproportionally weighted in favor of Standard American English . prior work on dialect struggle with generalizing to evolving and emerging dialects in a scalable manner. |
| Approach: | They propose a method that leverages linguistic knowledge to enable resource-efficient adaptation . their method disentangles dialect-specific and cross-dialectal information . |
| Outcome: | a new method improves generalization to unseen dialects in a task-agnostic fashion . it achieves the best or most competitive performance across 5 dialects . |
DADA: Dialect Adaptation via Dynamic Aggregation of Linguistic Rules (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) that focus on Standard American English (SAE) often suffer from performance degradation when applied to other dialects. |
| Approach: | They propose a modular approach to imbue SAE-trained models with multi-dialectal robustness . they propose adapters which handle specific linguistic features to imbibe SAe-taught models . |
| Outcome: | The proposed approach improves performance across multiple dialects and dialects. |
DialUp! Modeling the Language Continuum by Adapting Models to Dialects and Dialects to Models (2025.acl-long)
Copied to clipboard
Niyati Bafna, Emily Chang, Nathaniel Romney Robinson, David R. Mortensen, Kenton Murray, David Yarowsky, Hale Sirin
| Challenge: | Recent advances in MT quality and language coverage have shown that language varieties with low baseline performance are more likely to benefit from these approaches. |
| Approach: | They propose a training-time technique for adapting a pretrained model to dialectal data and an inference-time intervention adapting dialectal datasets to the model expertise. |
| Outcome: | The proposed model shows significant performance gains for several dialects from four language families, and modest gains for two other language families. |
Assessing Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks (2025.acl-long)
Copied to clipboard
Fangru Lin, Shaoguang Mao, Emanuele La Malfa, Valentin Hofmann, Adrian de Wynter, Xun Wang, Si-Qing Chen, Michael J. Wooldridge, Janet B. Pierrehumbert, Furu Wei
| Challenge: | a study aims to assess the fairness and robustness of Large Language Models in dialectal queries . speakers of "non-standard" dialects are known to experience implicit and explicit discrimination . |
| Approach: | They propose to use a benchmark to assess the fairness of large language models in dialects . they hire speakers with computer science backgrounds to rewrite seven popular benchmarks based on AAVE . |
| Outcome: | The proposed benchmarks show that most models show significant brittleness and unfairness to queries in AAVE. |
Task-agnostic Distillation of Encoder-Decoder Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing distillation methods that focus on encoder-only LMs fail to handle the distillation of encoder decoder LM. |
| Approach: | They propose a method that finetunes pretrained language models (LMs) they propose 'MiniEnD' that allows for task-agnostic distillation of LMs. |
| Outcome: | The proposed distillation method is generally effective and competitive compared to other alternatives. |
Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Tasks (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) pre-trained on massive text data in many languages are preferred solution for various Natural Language processing tasks. |
| Approach: | They compare tokenization parity and information parity as representational biases in pre-trained models . they find TP is better predictor of performance on tasks reliant on syntactic and morphological cues . |
| Outcome: | The proposed model improves on dialect classification, topic classification, and extractive question answering tasks. |
Multi-VALUE: A Framework for Cross-Dialectal English NLP (2023.acl-long)
Copied to clipboard
| Challenge: | Current systems that focus on standard American English are not dialect invariant . current systems focus on a single dialect, which results in performance discrepancies . |
| Approach: | They propose a resource for evaluating and achieving English dialect invariance . they stress test question answering, machine translation, and semantic parsing . |
| Outcome: | The proposed system is based on a rule-based translation system spanning 50 English dialects and 189 unique linguistic features. |
Mind the Gap in Cultural Alignment: Task-Aware Culture Management for Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing cultural alignment approaches fail to align LLMs’ broad cultural values with the specific goals of downstream tasks and suffer from cross-cultural interference. |
| Approach: | They propose a novel pipeline for task-specific cultural alignment that synthesizes task-aware cultural data in line with target task formats. |
| Outcome: | Experiments across five national cultures and ten culture-sensitive tasks show consistent improvements over prompt-based and fine-tuning baselines. |
Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers (2024.naacl-short)
Copied to clipboard
| Challenge: | Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. |
| Approach: | They propose a method to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers in the absence of human experts. |
| Outcome: | The proposed method extracts key language-specific lexical features that contribute to dialectal variations. |
Findings of the Association for Computational Linguistics: EMNLP 2020 (2020.findings-emnlp)
Copied to clipboard
| Challenge: | . - (EN) |
| Approach: | . - (EN) |
| Outcome: | . - (EN) |