Challenge: Dialectal Arabic datasets embody a range of domain, dialect, and quality.
Approach: They propose a framework for automatic speech recognition in dialectal Arabic to address the limited data availability encountered in dialects.
Outcome: The proposed framework provides access to 31 datasets covering 14 dialects to better address the limited data availability encountered in dialectal Arabic speech processing.

Similar Papers

Hierarchical Aggregation of Dialectal Data for Arabic Dialect Identification (2022.lrec-1)

Copied to clipboard

Challenge: Previous work on Arabic Dialect identification focused on specific dialect levels and labels . since dialectal differences tend to be more subtle relative terms to language differences, the DID task is harder than language identification.
Approach: They propose to define a standard hierarchical schema for Arabic Dialect identification . they map 29 different data sets to this schema and use it to aggregate the data .
Outcome: The proposed schemas and methods are extensible to other languages and dialect groups.
Casablanca: Data and Models for Multidialectal Arabic Speech Recognition (2024.emnlp-main)

Copied to clipboard

Challenge: despite recent advances in speech processing, the majority of world languages and dialects remain uncovered.
Approach: They propose to collect and transcribe a new Arabic dataset for eight dialects . they also develop strong baselines exploiting the new dataset .
Outcome: The proposed dataset covers eight Arabic dialects, including Algerian, Egyptian, Emirati, Jordanian, Mauritanian, Moroccan, Palestinian, and Yemeni.
ALDi: Quantifying the Arabic Level of Dialectness of Text (2023.emnlp-main)

Copied to clipboard

Challenge: Existing work on Dialect Identification (DI) on the sentence level has focused on binary tasks, whereas ALDi treats the task as binary.
Approach: They propose a dataset which contains 127,835 sentences manually labeled with their level of dialectness.
Outcome: The proposed model can identify dialectness on a range of other corpora, providing a more nuanced picture than traditional DI systems.
AraBench: Benchmarking Dialectal Arabic-English Machine Translation (2020.coling-main)

Copied to clipboard

Challenge: Existing efforts to translate Arabic dialects to English are limited due to the lack of evaluation benchmarks.
Approach: They propose an evaluation suite for Arabic to English machine translation using existing Arabic resources.
Outcome: The evaluation suite for Arabic to English machine translation is based on existing evaluation benchmarks.
Beyond Orthography: Automatic Recovery of Short Vowels and Dialectal Sounds in Arabic (2024.acl-long)

Copied to clipboard

Challenge: Existing algorithms for recognizing borrowed and dialectal sounds are limited to Arabic, a dialect-rich language containing more than 22 major dialects.
Approach: They propose a framework to recognize borrowed and dialectal sounds within phonologically diverse and dialect-rich languages that extends beyond its standard orthographic sound sets.
Outcome: The proposed framework improves character error rate by 7% with only one and half hours of training data compared to the baseline.
Unified Guidelines and Resources for Arabic Dialect Orthography (L18-1)

Copied to clipboard

Challenge: Existing efforts to conventionalize the dialectal orthography of Arabic have focused on specific dialects and made ad hoc decisions.
Approach: They propose a set of guidelines and meta-guidelines for conventional orthography of Arabic dialects . they apply them to 28 Arab city dialects from Rabat to Muscat .
Outcome: The proposed guidelines and resources are being used by three large Arabic dialect processing projects in three universities.
AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic (2025.findings-acl)

Copied to clipboard

Challenge: Dialectal Arabic (DA) varieties are under-served by language technologies, particularly large language models (LLMs).
Approach: They propose a framework that comprehensively assesses LLMs’ DA modeling capabilities across four dimensions: fidelity, understanding, quality, and diglossia.
Outcome: The proposed framework assesses LLMs’ DA modeling capabilities across four dimensions: fidelity, understanding, quality, and diglossia.
You Tweet What You Speak: A City-Level Dataset of Arabic Dialects (L18-1)

Copied to clipboard

Challenge: Existing studies of Arabic dialects have focused on blogs and comments on online news sites, but data on other dialects are costly and limited.
Approach: They present a dataset of > 1/4 billion tweets representing a wide range of Arabic dialects.
Outcome: The dataset represents 29 major Arab cities from 10 Arab countries with varying dialects.
The Arabic Generality Score: Another Dimension of Modeling Arabic Dialectness (2025.emnlp-main)

Copied to clipboard

Challenge: Recent work addresses this issue by modeling dialectness as a continuous variable . however, ALDi reduces complex variation to a single dimension .
Approach: They propose a way to model Arabic dialectness as a continuous variable . they propose etymology-aware edit distance and a regression model to model AGS .
Outcome: The proposed approach outperforms baselines on a multi-dialect benchmark.
Fine-Grained Arabic Dialect Identification (C18-1)

Copied to clipboard

Challenge: Existing work on Arabic Dialect Identification typically targeted coarse-grained five dialect classes plus Standard Arabic at most (6-way classification).
Approach: They propose to tackle a fine-grained Arabic dialect classification task covering 25 cities from across the Arab World, in addition to Standard Arabic.
Outcome: The proposed task can identify the exact city of a speaker at an accuracy of 67.9% for sentences with an average length of 7 words and reach more than 90% when we consider 16 words.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations