Papers by Vitobha Munigala
ODASim: Ordered, Distinctive and Absolute Semantic Similarity for Code Explanation Evaluation (2026.findings-acl)
Copied to clipboard
Prince Kumar, Vitobha Munigala, Jaydeep Sen, Ashish Mittal, Vishwajeet Kumar, Srikanth G. Tamilselvam
| Challenge: | Existing methods for code explanations fail to distinguish correct from partially or fully incorrect explanations and their similarity scores are poorly calibrated. |
| Approach: | They propose a model-agnostic graded fine-tuning framework that learns calibrated similarity representations between code and explanations to support fine-grained supervision and evaluation. |
| Outcome: | The proposed framework improves F1 score and ECE scores on two embedding models and reduces expected calibration error. |
Development of an Enterprise-Grade Contract Understanding System (2021.naacl-industry)
Copied to clipboard
Arvind Agarwal, Laura Chiticariu, Poornima Chozhiyath Raman, Marina Danilevsky, Diman Ghazi, Ankush Gupta, Shanmukha Guttula, Yannis Katsis, Rajasekar Krishnamurthy, Yunyao Li, Shubham Mudgal, Vitobha Munigala, Nicholas Phan, Dhaval Sonawane, Sneha Srinivasan, Sudarshan R. Thitte, Mitesh Vasa, Ramiya Venkatachalam, Vinitha Yaski, Huaiyu Zhu
| Challenge: | Currently, legal contract review remains an expensive and arduous process. |
| Approach: | They describe a commercial system designed and deployed for contract understanding that enables legal professionals to review contracts. |
| Outcome: | The proposed system is used by a wide range of enterprise users and solves three major challenges. |
ETF: An Entity Tracing Framework for Hallucination Detection in Code Summaries (2025.acl-long)
Copied to clipboard
Kishan Maharaj, Vitobha Munigala, Srikanth G. Tamilselvam, Prince Kumar, Sayandeep Sen, Palani Kodeswaran, Abhijit Mishra, Pushpak Bhattacharyya
| Challenge: | Recent advances in large language models have significantly enhanced their ability to understand both natural language and code, but are prone to hallucinations. |
| Approach: | They propose a first-of-its-kind dataset, CodeSumEval, with 10K samples, curated specifically for hallucination detection in code summarisation. |
| Outcome: | The proposed framework has a 73% F1 score and is curated specifically for detection of hallucinations in code summarisation. |