Papers by H Hasan
BEnQA: A Question Answering Benchmark for Bengali and English (2024.findings-acl)
Copied to clipboard
| Challenge: | a dataset of parallel Bengali and English exam questions is used to compare LLMs in low-resource languages. |
| Approach: | They introduce BEnQA, a dataset comprising parallel Bengali and English exam questions . they benchmark several Large Language Models with their parallel dataset and observe performance disparity . |
| Outcome: | The proposed dataset consists of 5K questions covering several subjects in science . the authors find that the models perform poorly in Bengali and English . |