Papers by Pramit Sahoo
DIWALI - Diversity and Inclusivity aWare cuLture specific Items for India: Dataset and Assessment of LLMs for Cultural Text Adaptation in Indian Context (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation metrics for cultural awareness and alignment are lacking . Existing datasets for culture specific items (CSIs) focus primarily on concepts at the regional level and may contain false positives. |
| Approach: | They propose a new CSI dataset for Indian culture that measures cultural competence . they use a CSI created by LLM as Judge and human evaluations from diverse regions . |
| Outcome: | The proposed model shows that it is capable of generating culturally relevant adaptations across multiple cultural facets. |