Papers by Samyadeep Basu
A Survey on LLM-based Conversational User Simulation (2026.eacl-long)
Copied to clipboard
Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi
| Challenge: | Recent advances in large language models (LLMs) have enabled high-fidelity generation of synthetic user conversation. |
| Approach: | They propose a taxonomy covering user granularity and simulation objectives . they analyze core techniques and evaluation methodologies to help them understand the latest developments . |
| Outcome: | The proposed model enables high-fidelity generation of synthetic user conversation. |
On Surgical Fine-tuning for Language Encoders (2023.findings-emnlp)
Copied to clipboard
Abhilasha Lodha, Gayatri Belapurkar, Saloni Chalkapurkar, Yuanming Tao, Reshmi Ghosh, Samyadeep Basu, Dmitrii Petrov, Soundararajan Srinivasan
| Challenge: | preserving knowledge of target distribution by fine-tuning all layers can be expensive and may increase data volume requirements. |
| Approach: | They propose an efficient metric based on the diagonal of the Fisher information matrix (FIM score) to select the candidate layers for selective fine-tuning. |
| Outcome: | The proposed metric can select layers leading to strong performance on GLUE and SuperGLUE tasks and across distinct language encoders. |
A Closer Look at Bias and Chain-of-Thought Faithfulness of Large (Vision) Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Chain-of-thought reasoning improves performance of large language models, but is it faithfully reflecting internal processes? |
| Approach: | They propose a new evaluation pipeline for categorizing bias articulation patterns and a novel evaluation pipeline to examine CoT faithfulness in large vision-language models. |
| Outcome: | The proposed evaluation pipeline enables significantly more precise analysis of CoT reasoning than previous methods. |
Distilling Knowledge from Text-to-Image Generative Models Improves Visio-Linguistic Reasoning in CLIP (2024.emnlp-main)
Copied to clipboard
| Challenge: | Image-text contrastive models like CLIP struggle on compositional visio-linguistic tasks where their performance is no better than random chance. |
| Approach: | They propose a distillation method to enhance CLIP's compositional visio-linguistic reasoning by using a model-derived distillation objective borrowed from large text-to-image generative models like Stable-Diffusion. |
| Outcome: | The proposed method improves CLIP models' visio-linguistic performance on the Winoground benchmark by 7% while on the ARO dataset, it boosts performance by 3%. |
Decomposition-Enhanced Training for Post-Hoc Attributions in Language Models (2026.eacl-long)
Copied to clipboard
Sriram Balasubramanian, Samyadeep Basu, Koustava Goswami, Ryan A. Rossi, Varun Manjunatha, Roshan Santhosh, Ruiyi Zhang, Soheil Feizi, Nedim Lipka
| Challenge: | Existing methods for extractive QA struggle in multi-hop, abstractive, and semi-extractive settings. |
| Approach: | They propose a method that prompts models to produce answer decompositions as intermediate reasoning steps. |
| Outcome: | The proposed method outperforms existing methods and matches or exceeds state-of-the-art frontier models. |
IntCoOp: Interpretability-Aware Vision-Language Prompt Tuning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing prompt-tuning frameworks lack interpretability, limiting their ability to understand compositional nature of images. |
| Approach: | They propose a prompt-tuning method that integrates compositional attributes into manual prompts to enhance image-text alignment scores. |
| Outcome: | The proposed method improves CoOp performance by 7.35% across 10 diverse datasets. |