Challenge: Arabic is a highly diglossic language where most daily communication occurs in regional dialects rather than modern standard Arabic (MSA).
Approach: They propose a large-scale, community-driven, human-translated dataset to bridge this gap . Alexandria covers 13 Arab countries and 11 high-impact domains . it provides unprecedented granularity by associating contributions with city-of-origin metadata .
Outcome: The Alexandria dataset covers 13 Arab countries and 11 high-impact domains . it provides unprecedented granularity by associating contributions with city-of-origin metadata . Alexandria is a training resource and a rigorous benchmark for evaluating MT and LLMs based on the Alexandria dataset .

Similar Papers

AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs (2025.coling-main)

Copied to clipboard

Challenge: a recent study has found that Arabic is underrepresented in Large Language Models, especially in dialectal variations.
Approach: They propose a benchmark for Arabic Dialect and Cultural Evaluation that evaluates Arabic dialect comprehension and generation.
Outcome: The proposed model outperforms multilingual models on dialect comprehension and generation, but significant challenges persist in dialect identification, generation, and translation.
AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic (2025.findings-acl)

Copied to clipboard

Challenge: Dialectal Arabic (DA) varieties are under-served by language technologies, particularly large language models (LLMs).
Approach: They propose a framework that comprehensively assesses LLMs’ DA modeling capabilities across four dimensions: fidelity, understanding, quality, and diglossia.
Outcome: The proposed framework assesses LLMs’ DA modeling capabilities across four dimensions: fidelity, understanding, quality, and diglossia.
Arab Voices: Mapping Standard and Dialectal Arabic Speech Technology (2026.findings-acl)

Copied to clipboard

Challenge: Dialectal Arabic datasets embody a range of domain, dialect, and quality.
Approach: They propose a framework for automatic speech recognition in dialectal Arabic to address the limited data availability encountered in dialects.
Outcome: The proposed framework provides access to 31 datasets covering 14 dialects to better address the limited data availability encountered in dialectal Arabic speech processing.
NileChat: Towards Linguistically Diverse and Culturally Aware LLMs for Local Communities (2025.emnlp-main)

Copied to clipboard

Challenge: Current research directions rely on synthetic data generated by translating English corpora, which often fails to represent the cultural heritage and values of local communities.
Approach: They propose a method to create and retrieve pre-training data tailored to a specific community . they use Egyptian and Moroccan dialects as testbeds to test their understanding .
Outcome: The proposed method outperforms existing Arabic-aware LLMs and performs on par with larger models.
The SADID Evaluation Datasets for Low-Resource Spoken Language Machine Translation of Arabic Dialects (2020.coling-main)

Copied to clipboard

Challenge: Low-resource Machine Translation (LRT) models are still lagging behind on low-resourced language pairs due to the scarcity of parallel training data.
Approach: They introduce benchmark datasets for Arabic and its dialects to examine their properties . they bootstrap existing parallel sentences and complement this with multilingual training .
Outcome: The proposed method bootstraps existing parallel sentences and complements multilingual training to achieve strong baselines.
Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues (2026.acl-long)

Copied to clipboard

Challenge: Most benchmarks focus on short text snippets in Modern Standard Arabic (MSA), overlooking cultural nuances that naturally arise in dialogues.
Approach: They propose a culturally grounded conversational dataset covering 13 Arabic-speaking countries, in both Modern Standard Arabic (MSA) and each country’s respective dialect, spanning 12 daily-life topics and 54 fine-grained subtopics.
Outcome: The proposed model performs worse on all three tasks than the MSA benchmark.
AraBench: Benchmarking Dialectal Arabic-English Machine Translation (2020.coling-main)

Copied to clipboard

Challenge: Existing efforts to translate Arabic dialects to English are limited due to the lack of evaluation benchmarks.
Approach: They propose an evaluation suite for Arabic to English machine translation using existing Arabic resources.
Outcome: The evaluation suite for Arabic to English machine translation is based on existing evaluation benchmarks.
AfriMMT-EA: Multi-domain Machine Translation for Low-Resource East African Languages (2026.findings-eacl)

Copied to clipboard

Challenge: Recent advances in open-source large language models have demonstrated strong multilingual capabilities through data-efficient adaptation strategies.
Approach: They propose to use AfriMMT-EA to refine two multilingual versions of Gemma-3 to better understand the region's linguistic and cultural diversity.
Outcome: The proposed datasets comprise 54 local languages across five East African countries.
Casablanca: Data and Models for Multidialectal Arabic Speech Recognition (2024.emnlp-main)

Copied to clipboard

Challenge: despite recent advances in speech processing, the majority of world languages and dialects remain uncovered.
Approach: They propose to collect and transcribe a new Arabic dataset for eight dialects . they also develop strong baselines exploiting the new dataset .
Outcome: The proposed dataset covers eight Arabic dialects, including Algerian, Egyptian, Emirati, Jordanian, Mauritanian, Moroccan, Palestinian, and Yemeni.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations