Highly Effective Arabic Diacritization using Sequence to Sequence Modeling (N19-1)
Copied to clipboard
| Challenge: | Arabic text is written without short vowels (or diacritics) their presence is essential for properly verbalizing Arabic . |
| Approach: | They propose a character-level sequence-to-sequence deep learning model that recovers both types of diacritics without the use of explicit feature engineering. |
| Outcome: | The proposed model outperforms all previous state-of-the-art models on overlapping windows of words . it achieves a word error rate (WER) of 4.49% compared to the state- of-the art systems . |
Similar Papers
A System for Diacritizing Four Varieties of Arabic (D19-3)
Copied to clipboard
| Challenge: | Short vowels, aka diacritics, are omitted when writing different varieties of Arabic . diacritization is essential for language learning and text-to-speech applications . |
| Approach: | They propose a system for recovering diacritics in Arabic without short vowels . they use a character-based sequence-to-sequence deep learning model . |
| Outcome: | The proposed system beats all previous SOTA systems for Arabic varieties . it uses a character-based sequence-to-sequence deep learning model . |
Advancing Arabic Diacritization: Improved Datasets, Benchmarking, and State-of-the-Art Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Arabic diacritics are typically omitted in written Arabic, leading to ambiguity . authors propose a methodology to analyze and refine a large diacritized corpus . |
| Approach: | They propose a methodology to analyze and refine a large diacritized corpus to improve training quality. |
| Outcome: | The proposed model achieves state-of-the-art results with 3.12% and 2.70% WER on WikiNews-2014 and Wikinews-2024. |
Arabic Diacritization Using Morphologically Informed Character-Level Model (2024.lrec-main)
Copied to clipboard
Muhammad Morsy Elmallah, Mahmoud Reda, Kareem Darwish, Abdelrahman El-Sheikh, Ashraf Hatim Elneima, Murtadha Aljubran, Nouf Alsaeed, Reem Mohammed, Mohamed Al-Badrashiny
| Challenge: | Diacritics are typically omitted in Arabic writings and the reader needs to guess the proper diacritics as they are reading. |
| Approach: | They propose a morphologically informed character-level model that can recover both types of diacritics simultaneously. |
| Outcome: | The proposed model achieves lowest word-level diacritization error rate for Classical Arabic, MSA, and two dialectal Arabic texts. |
Neural Arabic Text Diacritization: State of the Art Results and a Novel Approach for Machine Translation (D19-52)
Copied to clipboard
| Challenge: | a number of Arabic text diacritizers use diacritics to convey information about meaning of a word . Arabic text to speech (TTS) requires a complex process to determine the correct diacritical for each character . |
| Approach: | They propose to use Arabic diacritization to enhance machine translation models . they propose to build automatic Arabic text diacritics using two approaches . |
| Outcome: | The proposed models are either better or on par with other models, which require language-dependent post-processing steps, unlike ours. |
A Multitask Learning Approach for Diacritic Restoration (2020.acl-main)
Copied to clipboard
| Challenge: | Diacritics are used to specify pronunciations and meanings in many languages like Arabic. |
| Approach: | They propose to use multi-task learning to optimize diacritic restoration with related NLP problems . they use Arabic as a case study since it has sufficient data resources for tasks . |
| Outcome: | The proposed model outperforms baseline models and is comparable to the state-of-the-art models. |
Improving Arabic Diacritization with Regularized Decoding and Adversarial Training (2021.acl-short)
Copied to clipboard
| Challenge: | Existing studies regard auto-generated knowledge instances as gold references, which limits their effectiveness since they are not always accurate and inferior instances can lead to incorrect predictions. |
| Approach: | They propose to use regularized decoding and adversarial training to appropriately learn from noisy knowledge instances for Arabic diacritization. |
| Outcome: | The proposed model outperforms existing models on two benchmark datasets even with flawed auto-generated knowledge. |
Diacritics Restoration Using Neural Networks (L18-1)
Copied to clipboard
| Challenge: | a novel combination of character-level recurrent neural network and language model is proposed . people often replace characters with diacritics with their ASCII counterparts . |
| Approach: | They propose a character-level recurrent neural network-based model and a language model for diacritics restoration. |
| Outcome: | The proposed model reduces error of current best systems by 20% to 64% on four languages . it is also able to restore diacritical marks on a number of languages using the same model . |
Enhancing Arabic NLP Tasks through Character-Level Models and Data Augmentation (2025.coling-main)
Copied to clipboard
| Challenge: | Using character-level models, natural language processing for Arabic is challenging due to its rich morphology, root-based word formation, flexible sentence structures, diacritical ambiguities, and orthographic variations. |
| Approach: | They propose a character-level approach specifically designed for Arabic NLP tasks that incorporates Convolutional Neural Networks (CNNs), pre-trained transformers (CANINE), and Bidirectional Long Short-Term Memory networks (BiLSTMs). |
| Outcome: | The proposed model outperforms existing models on Arabic privacy policy classification task and reports a micro-averaged F1 score of 93.8%, surpassing state-of-the-art models. |
DiaSet: An Annotated Dataset of Arabic Conversations (2024.lrec-main)
Copied to clipboard
Abraham Israeli, Aviv Naaman, Guy Maduel, Rawaa Makhoul, Dana Qaraeen, Amir Ejmail, Dina Lisnanskey, Julian Jubran, Shai Fine, Kfir Bar
| Challenge: | DiaSet is a dataset of dialectical Arabic speech manually transcribed and annotated for two downstream tasks. |
| Approach: | They propose to manually transcribe and annotate Arabic speech for sentiment analysis and named entity recognition. |
| Outcome: | The proposed dataset encapsulates the Palestine dialect, predominantly spoken in Palestine, Israel, and Jordan. |
LAMAD: A Linguistic Attentional Model for Arabic Text Diacritization (2021.findings-emnlp)
Copied to clipboard
| Challenge: | In Arabic, diacritics are often omitted from written texts increasing the number of possible meanings and pronunciations. |
| Approach: | They propose a linguistic attentional model for Arabic text diacritization which captures key linguistic features from Arabic text. |
| Outcome: | The proposed model outperforms existing state-of-the-art models on three datasets with different sizes. |