Papers by Abdulmohsen Al-Thubaity
LC-Eval: A Bilingual Multi-Task Evaluation Benchmark for Long-Context Understanding (2025.findings-emnlp)
Copied to clipboard
Sheikh Jubair, Arwa Omayrah, Amal Alshammari, Alhanoof Althnian, Abdulhamed Alothaimen, Norah A. Alzahrani, Shahad D. Alzaidi, Nora Al-Twairesh, Abdulmohsen Al-Thubaity
| Challenge: | Recent advances in Large Language Models (LLMs) have demonstrated sophisticated capabilities, including the ability to process and comprehend extended contexts. |
| Approach: | They propose a bilingual, multi-task evaluation benchmark designed to evaluate long-context understanding in English and Arabic. |
| Outcome: | The proposed benchmark targets context lengths ranging from 4k to over 128k tokens. |
AraEval: An Arabic Multi-Task Evaluation Suite for Large Language Models (2025.emnlp-main)
Copied to clipboard
Alhanoof Althnian, Norah A. Alzahrani, Shaykhah Z. Alsubaie, Eman Albilali, Ahmed Abdelali, Nouf M. Alotaibi, M Saiful Bari, Yazeed Alnumay, Abdulhamed Alothaimen, Maryam Saif, Shahad D. Alzaidi, Faisal Abdulrahman Mirza, Yousef Almushayqih, Mohammed Al Saleem, Ghadah Alabduljabbar, Abdulmohsen Al-Thubaity, Areeb Alowisheq, Nora Al-Twairesh
| Challenge: | AraEval is a suite of evaluation tasks designed to assess the advanced knowledge, reasoning, truthfulness, and instruction following capabilities of large language models. |
| Approach: | They propose to use AraEval to assess the advanced knowledge, reasoning, truthfulness, and instruction following capabilities of large language models in the Arabic context. |
| Outcome: | The evaluation suite covers a broad spectrum of domains, including science, history, religion, and literature. |