Papers by Md Kowsher
TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarking (2025.findings-acl)
Copied to clipboard
Shahriar Kabir Nahin, Rabindra Nath Nandi, Sagor Sarker, Quazi Sarwar Muhtaseem, Md Kowsher, Apu Chandraw Shill, Md Ibrahim, Mehadi Hasan Menon, Tareq Al Muntasir, Firoj Alam
| Challenge: | Existing benchmarking datasets for Bangla LLMs are not available for all languages. |
| Approach: | They present TituLLMs, the first large pretrained Bangla LLMs, available in 1b and 3b parameter sizes. |
| Outcome: | The proposed model outperforms existing models in Bangla, but not always in the first place. |
BnTTS: Few-Shot Speaker Adaptation in Low-Resource Setting (2025.findings-naacl)
Copied to clipboard
Mohammad Jahid Ibna Basher, Md Kowsher, Md Saiful Islam, Rabindra Nath Nandi, Nusrat Jahan Prottasha, Mehadi Hasan Menon, Tareq Al Muntasir, Shammur Absar Chowdhury, Firoj Alam, Niloofar Yousefi, Ozlem Garibay
| Challenge: | Empirical evaluations in few-shot settings show that BnTTS significantly improves the naturalness, intelligibility, and speaker fidelity of synthesized Bangla speech. |
| Approach: | They propose to integrate Bangla into a multilingual TTS pipeline with modifications to account for the phonetic and linguistic characteristics of the language. |
| Outcome: | The proposed framework improves the naturalness, intelligibility, and speaker fidelity of synthesized Bangla speech compared to state-of-the-art systems. |
Does Self-Attention Need Separate Weights in Transformers? (2025.naacl-industry)
Copied to clipboard
| Challenge: | Experimental results show a 66.53% reduction in parameter size within the attention block and competitive accuracy improvements of 3.55% and 0.89% over symmetric and pairwise attention-based models, respectively. |
| Approach: | They propose a simplified approach where a single weight matrix is used for Keys, Queries, and Values instead of separate matrices for each. |
| Outcome: | The proposed approach outperforms the BERT baseline on GLUE tasks even outperforming the standard BERT model in handling noisy and out-of-domain data. |
RoCoFT: Efficient Finetuning of Large Language Models with Row-Column Updates (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning large language models use full finetunation, but this is impractical as language models continue to scale up. |
| Approach: | They propose a parameter-efficient fine-tuning method for large language models based on updating only a few rows and columns of the weight matrices in transformers. |
| Outcome: | The proposed method gives comparable or better accuracies than state-of-the-art methods while being more memory and computation-efficient. |
Propulsion: Steering LLM with Tiny Fine-Tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Propulsion is a parameter-efficient fine-tuning method that selectively re-scales specific dimensions of a pre-trained model without modifying the model’s parameters. |
| Approach: | They propose a parameter-efficient fine-tuning method that selectively re-scales specific dimensions of a pre-trained model without modifying the parameters. |
| Outcome: | The proposed method reduces parameter count from 355.3 million to 0.086 million while maintaining competitive performance across benchmarks. |
Predicting Through Generation: Why Generation Is Better for Prediction (2025.acl-long)
Copied to clipboard
Md Kowsher, Nusrat Jahan Prottasha, Prakash Bhat, Chun-Nam Yu, Mojtaba Soltanalian, Ivan Garibay, Ozlem Garibay, Chen Chen, Niloofar Yousefi
| Challenge: | Large Language Models (LLMs) are increasingly used for predictive tasks such as classification and regression. |
| Approach: | They propose a framework that generates output tokens from mas-sive text corpora and a task adapter to ensure consistency between token generation and final prediction. |
| Outcome: | The proposed framework outperforms baseline models on classification and regression benchmarks and the proposed framework consistently outperformed standard baseline models. |