Papers by Rahul Sharma
Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs (2024.findings-naacl)
Copied to clipboard
Victor Carbune, Hassan Mansoor, Fangyu Liu, Rahul Aralikatte, Gilles Baechler, Jindong Chen, Abhanshu Sharma
| Challenge: | Visual language models (VLMs) are achieving increasingly strong performance on multimodal tasks. |
| Approach: | They propose to transfer reasoning capabilities from large-language models to VLMs by constructing a 20x larger dataset and a larger dataset to improve general reasoning capabilities. |
| Outcome: | The proposed model outperforms larger models without an upstream OCR system while keeping inference time constant. |
Alignment Quality Index (AQI) : Beyond Refusals: AQI as an Intrinsic Alignment Diagnostic via Latent Geometry, Cluster Divergence, and Layer wise Pooled Representations (2025.emnlp-main)
Copied to clipboard
Abhilekh Borah, Chhavi Sharma, Danush Khanna, Utkarsh Bhatt, Gurpreet Singh, Hasnat Md Abdullah, Raghav Kaushik Ravi, Vinija Jain, Jyoti Patel, Shubham Singh, Vasu Sharma, Arpita Vats, Rahul Raja, Aman Chadha, Amitava Das
| Challenge: | a new metric measures the quality of large language models (LLMs) that detects hidden misalignments and jailbreak risks. |
| Approach: | They propose a decoding-invariant metric that measures latent safety failures . they propose 'Alignment Quality Index' to measure latent activations in latent space . |
| Outcome: | The proposed metric detects latent safety failures overlooked by behavioral benchmarks and jailbreaks. |
Dataset for Identification of Homophobia and Transphobia for Telugu, Kannada, and Gujarati (2024.lrec-main)
Copied to clipboard
| Challenge: | There has been a rise in homophobic and transphobic content targeting LGBT+ individuals on social media platforms. |
| Approach: | They propose to use a dataset to automatically identify homophobic and transphobic content within comments collected from YouTube for three languages. |
| Outcome: | The proposed dataset will identify homophobic and transphobic content within comments collected from YouTube in Telugu, Kannada, and Gujarati. |
Ranking LLM-Generated Loop Invariants for Program Verification (2023.findings-emnlp)
Copied to clipboard
Saikat Chakraborty, Shuvendu Lahiri, Sarah Fakhoury, Akash Lal, Madanlal Musuvathi, Aseem Rastogi, Aditya Senthilnathan, Rahul Sharma, Nikhil Swamy
| Challenge: | Large Language Models (LLMs) are capable of synthesizing inductive loop invariants for a class of programs in a 0-shot setting, yet require several samples to generate the correct invariant. |
| Approach: | They propose a re-ranking approach to generate inductive loop invariants using Large Language Models . they propose reranking rankers that can distinguish between correct and incorrect attempts . |
| Outcome: | The proposed method reduces the number of calls to a verifier by comparing the generated results with the original model. |
Federated Learning with Noisy User Feedback (2022.naacl-main)
Copied to clipboard
Rahul Sharma, Anil Ramakrishna, Ansel MacLaughlin, Anna Rumshisky, Jimit Majmudar, Clement Chung, Salman Avestimehr, Rahul Gupta
| Challenge: | Artificial Intelligence (AI) and Machine Learning (ML) systems are becoming more popular and are causing concerns over user privacy. |
| Approach: | They propose a method for training ML models using positive and negative user feedback and a framework to extract labels on edge to make FL viable. |
| Outcome: | The proposed method improves significantly over a self-training baseline, achieving performance closer to models trained with full supervision. |