The MADAR Arabic Dialect Corpus and Lexicon (L18-1)

Copied to clipboard

Challenge: Using a corpus of 25 Arabic city dialects and a lexicon of 1,045 concepts, we study 25 cities in a travel domain . focus on cities opens new avenues for research from dialectology to dialect identification and machine translation.
Approach: They present two Arabic language resources that are part of the Multi Arabic Dialect Applications and Resources project.
Outcome: The proposed resources are the first of their kind in terms of their coverage and fine granularity.

Similar Papers

A Spelling Correction Corpus for Multiple Arabic Dialects (2020.lrec-1)

Copied to clipboard

Challenge: Arabic dialects are non-standard varieties of Arabic commonly spoken across the Arab world, but lack standard orthographies.
Approach: They present a corpus of 10,000 sentences from five Arabic city dialects represented in the Conventional Orthography for Dialectal Arabic (CODA) they use a bootstrapping technique to speed up annotation and compare similarity between dialects before and after CODA annotation.
Outcome: The proposed method speeds up the annotation process and shows similarity between the dialects before and after CODA annotation.
Fine-Grained Arabic Dialect Identification (C18-1)

Copied to clipboard

Challenge: Existing work on Arabic Dialect Identification typically targeted coarse-grained five dialect classes plus Standard Arabic at most (6-way classification).
Approach: They propose to tackle a fine-grained Arabic dialect classification task covering 25 cities from across the Arab World, in addition to Standard Arabic.
Outcome: The proposed task can identify the exact city of a speaker at an accuracy of 67.9% for sentences with an average length of 7 words and reach more than 90% when we consider 16 words.
The Bahrain Corpus: A Multi-genre Corpus of Bahraini Arabic (2022.lrec-1)

Copied to clipboard

Challenge: Various corpora of various sizes and representing different genres, have been created for various Arabic dialects.
Approach: They propose to create a specialized corpus of Bahraini Arabic dialect, which includes written texts as well as transcripts of audio files.
Outcome: The proposed corpus includes 620K words representing the Bahraini Arabic dialect . the annotated corpus is available to support researchers interested in Arabic NLP .
You Tweet What You Speak: A City-Level Dataset of Arabic Dialects (L18-1)

Copied to clipboard

Challenge: Existing studies of Arabic dialects have focused on blogs and comments on online news sites, but data on other dialects are costly and limited.
Approach: They present a dataset of > 1/4 billion tweets representing a wide range of Arabic dialects.
Outcome: The dataset represents 29 major Arab cities from 10 Arab countries with varying dialects.
A Morphologically Annotated Corpus of Emirati Arabic (L18-1)

Copied to clipboard

Challenge: Emirati Arabic corpus is first large-scale morphologically manually annotated corpus . resources for dialectal Arabic NLP tasks are still lacking compared to those for modern standard Arabic (MSA).
Approach: They propose to annotate a large-scale corpus of Emirati Arabic using a morphologically manually annotated corpus from eight Gumar novels . they discuss the guidelines for each part of the annotation components, and the annotation interface they use.
Outcome: The annotated corpus includes about 200,000 words from eight Gumar novels in the Emirati Arabic variety.
Hierarchical Aggregation of Dialectal Data for Arabic Dialect Identification (2022.lrec-1)

Copied to clipboard

Challenge: Previous work on Arabic Dialect identification focused on specific dialect levels and labels . since dialectal differences tend to be more subtle relative terms to language differences, the DID task is harder than language identification.
Approach: They propose to define a standard hierarchical schema for Arabic Dialect identification . they map 29 different data sets to this schema and use it to aggregate the data .
Outcome: The proposed schemas and methods are extensible to other languages and dialect groups.
Casablanca: Data and Models for Multidialectal Arabic Speech Recognition (2024.emnlp-main)

Copied to clipboard

Challenge: despite recent advances in speech processing, the majority of world languages and dialects remain uncovered.
Approach: They propose to collect and transcribe a new Arabic dataset for eight dialects . they also develop strong baselines exploiting the new dataset .
Outcome: The proposed dataset covers eight Arabic dialects, including Algerian, Egyptian, Emirati, Jordanian, Mauritanian, Moroccan, Palestinian, and Yemeni.
Unified Guidelines and Resources for Arabic Dialect Orthography (L18-1)

Copied to clipboard

Challenge: Existing efforts to conventionalize the dialectal orthography of Arabic have focused on specific dialects and made ad hoc decisions.
Approach: They propose a set of guidelines and meta-guidelines for conventional orthography of Arabic dialects . they apply them to 28 Arab city dialects from Rabat to Muscat .
Outcome: The proposed guidelines and resources are being used by three large Arabic dialect processing projects in three universities.
Arabic Speech Rhythm Corpus: Read and Spontaneous Speaking Styles (2020.lrec-1)

Copied to clipboard

Challenge: a corpus of Arabic speech recordings has been built to allow comparisons between Arabic and other languages.
Approach: They propose to build a corpus of Arabic speech recordings that can be compared with other languages.
Outcome: The proposed corpus can be used for forensic phonetic research and casework applications.
Arab Voices: Mapping Standard and Dialectal Arabic Speech Technology (2026.findings-acl)

Copied to clipboard

Challenge: Dialectal Arabic datasets embody a range of domain, dialect, and quality.
Approach: They propose a framework for automatic speech recognition in dialectal Arabic to address the limited data availability encountered in dialects.
Outcome: The proposed framework provides access to 31 datasets covering 14 dialects to better address the limited data availability encountered in dialectal Arabic speech processing.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations