Challenge: Current research directions rely on synthetic data generated by translating English corpora, which often fails to represent the cultural heritage and values of local communities.
Approach: They propose a method to create and retrieve pre-training data tailored to a specific community . they use Egyptian and Moroccan dialects as testbeds to test their understanding .
Outcome: The proposed method outperforms existing Arabic-aware LLMs and performs on par with larger models.

Similar Papers

Where Are We? Evaluating LLM Performance on African Languages (2025.acl-long)

Copied to clipboard

Challenge: African languages are underrepresented in NLP due to policies that favor foreign languages and create data inequities.
Approach: They integrate theoretical insights on Africa’s language landscape with an empirical evaluation using Sahara datasets.
Outcome: The proposed model improves on a benchmark curated from large-scale, publicly accessible datasets capturing the continent's linguistic diversity.
Alexandria: A Multi-Domain Dialectal Arabic Machine Translation Dataset for Culturally Inclusive and Linguistically Diverse LLMs (2026.acl-long)

Copied to clipboard

Challenge: Arabic is a highly diglossic language where most daily communication occurs in regional dialects rather than modern standard Arabic (MSA).
Approach: They propose a large-scale, community-driven, human-translated dataset to bridge this gap . Alexandria covers 13 Arab countries and 11 high-impact domains . it provides unprecedented granularity by associating contributions with city-of-origin metadata .
Outcome: The Alexandria dataset covers 13 Arab countries and 11 high-impact domains . it provides unprecedented granularity by associating contributions with city-of-origin metadata . Alexandria is a training resource and a rigorous benchmark for evaluating MT and LLMs based on the Alexandria dataset .
AceGPT, Localizing Large Language Models in Arabic (2024.naacl-long)

Copied to clipboard

Challenge: Significant concerns emerge when addressing cultural sensitivity and local values.
Approach: They propose a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models.
Outcome: The proposed model sets the state-of-the-art standard for open Arabic LLMs across various benchmarks.
AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic (2025.findings-acl)

Copied to clipboard

Challenge: Dialectal Arabic (DA) varieties are under-served by language technologies, particularly large language models (LLMs).
Approach: They propose a framework that comprehensively assesses LLMs’ DA modeling capabilities across four dimensions: fidelity, understanding, quality, and diglossia.
Outcome: The proposed framework assesses LLMs’ DA modeling capabilities across four dimensions: fidelity, understanding, quality, and diglossia.
AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs (2025.coling-main)

Copied to clipboard

Challenge: a recent study has found that Arabic is underrepresented in Large Language Models, especially in dialectal variations.
Approach: They propose a benchmark for Arabic Dialect and Cultural Evaluation that evaluates Arabic dialect comprehension and generation.
Outcome: The proposed model outperforms multilingual models on dialect comprehension and generation, but significant challenges persist in dialect identification, generation, and translation.
JAWAHER: A Multidialectal Dataset of Arabic Proverbs for LLM Benchmarking (2025.naacl-long)

Copied to clipboard

Challenge: Recent advances in instruction fine-tuning and alignment methods have enhanced the adaptability of large language models to user preferences.
Approach: They propose a benchmark to assess LLMs’ capacity to comprehend and interpret Arabic proverbs.
Outcome: The proposed model can generate accurate translations, but struggle to produce culturally nuanced and contextually relevant explanations.
AfriVox: Probing Multilingual and Accent Robustness of Speech LLMs (2026.eacl-long)

Copied to clipboard

Challenge: Recent advances in multimodal and speech-native large language models have delivered impressive speech recognition, translation, understanding, and question-answering capabilities for high-resource languages.
Approach: They propose to benchmark African languages and African-accented French, Arabic, and 100+ African English accents across 20 African languages.
Outcome: The proposed model outperforms traditional speech transcription and translation models in African languages and non-native French or English accents.
TounsiBench: Benchmarking Large Language Models for Tunisian Arabic (2025.emnlp-main)

Copied to clipboard

Challenge: a dataset of Tunisian Arabic instructions and prompts is used to evaluate LLMs' ability to understand and generate responses in Tunisia . we assess the quality, correctness, relevance, and dialectal adherence of LLM responses .
Approach: They propose a benchmark for evaluating the capabilities of large language models in Tunisian Arabic . they use a dataset of Tunisia Arabic instructions and prompts to evaluate their models .
Outcome: The proposed model can judge quality, correctness, relevance, and dialectal adherence . the model can also generate a leaderboard for the Tunisian Arabic language .
NativQA: Multilingual Culturally-Aligned Natural Query for LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing frameworks for QA datasets lack regional specificity and cultural specificity.
Approach: They propose a framework to quench native language QA datasets in native languages for LLM evaluation and tuning.
Outcome: The proposed framework is scalable, language-independent and can be used to build culturally and regionally aligned QA datasets in native languages.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations