Papers by Adil Bahaj

Copied to clipboard

Challenge:	Using a benchmark, large language models can be evaluated on Moroccan legal MCQs . despite their ability to comprehend and process Arabic, the language is still a challenge .
Approach:	They propose a benchmark for assessing LLMs on Moroccan legal MCQs . they use Arabic-based questions enriched with Moroccan idioms to assess their accuracy .
Outcome:	The proposed benchmark covers 1,776 expert-verified questions in Arabic enriched with Moroccan idioms . it measures accuracy, precision-penalized F1-like score, and calibration errors .