Papers by Dhruv Choudhary
Harmless Transfer Learning for Item Embeddings (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to learn item embeddings for categorical features are limited by the frequency of items in real-world. |
| Approach: | They propose a method that transfers knowledge from frequent items to rare items by introducing an auxiliary transfer loss. |
| Outcome: | The proposed framework significantly boosts the performance on a variety of NLP and recommendation system tasks. |
Nanda Family: Open-Weights Generative Large Language Models for Hindi (2026.eacl-long)
Copied to clipboard
Aaryamonvikram Singh, Debopriyo Banerjee, Dhruv Sahnan, Monojit Choudhury, Shivam Chauhan, Rocktim Jyoti Das, Xudong Han, Haonan Li, Alok Anil Jadhav, Utkarsh Agarwal, Mukund Choudhary, Fajri Koto, Junaid Hamid Bhat, Awantika Shukla, Samujjwal Ghosh, Samta Kamboj, Onkar Pandit, Lalit Pradhan, Rahul Pal, Sunil Kumar Sahu, Parvez Mullah, Ali El Filali, Zainul Abedien Ahmed Quraishi, Neha Sengupta, Gokulakrishnan Ramakrishnan, Rituraj Joshi, Gurpreet Gosal, Avraham Sheinin, Natalia Vassilieva, Preslav Nakov
| Challenge: | Large language models remain predominantly English-centric, which limits their utility for underrepresented languages. |
| Approach: | They propose to extend Llama’s vocabulary with 20% Hindi-specific tokens, thus halving Hindi tokenization fertility while preserving English efficiency. |
| Outcome: | The proposed models outperform open-weight models of comparable size on a 65B-token corpus and bilingual instruction and safety alignment on . a culturally grounded dataset. |