Papers by Tonmoy Rajkhowa
Evaluating the Efficacy of Large Acoustic Model for Documenting Non-Orthographic Tribal Languages in India (2024.lrec-main)
Copied to clipboard
| Challenge: | Pre-trained Large Acoustic Models have been shown to improve performance in spoken languages . however, their potential for novel under-resourced languages is not fully known . |
| Approach: | They propose to use pre-trained Large Acoustic Models to document under-resourced languages . they use scripts from languages that hold a prominent presence in the geographical regions . |
| Outcome: | The proposed model can document under-resourced languages in the electronic domain . the model can be used to document languages with a written script . |
Towards Multilingual spoken Visual Question Answering system using Cross-Attention (2025.coling-main)
Copied to clipboard
| Challenge: | Visual question answering (VQA) is a multi-modal translation challenge that requires the analysis of both images and questions simultaneously to generate appropriate responses. |
| Approach: | They propose a textless multilingual visual question answering dataset that incorporates speech-based questions in English, german, spanish and french. |
| Outcome: | The proposed framework is superior to existing frameworks for speech-based VQA . the proposed framework can generate better results for image, text and audio representations . |