Papers by Shubham Jain
Alignment Quality Index (AQI) : Beyond Refusals: AQI as an Intrinsic Alignment Diagnostic via Latent Geometry, Cluster Divergence, and Layer wise Pooled Representations (2025.emnlp-main)
Copied to clipboard
Abhilekh Borah, Chhavi Sharma, Danush Khanna, Utkarsh Bhatt, Gurpreet Singh, Hasnat Md Abdullah, Raghav Kaushik Ravi, Vinija Jain, Jyoti Patel, Shubham Singh, Vasu Sharma, Arpita Vats, Rahul Raja, Aman Chadha, Amitava Das
| Challenge: | a new metric measures the quality of large language models (LLMs) that detects hidden misalignments and jailbreak risks. |
| Approach: | They propose a decoding-invariant metric that measures latent safety failures . they propose 'Alignment Quality Index' to measure latent activations in latent space . |
| Outcome: | The proposed metric detects latent safety failures overlooked by behavioral benchmarks and jailbreaks. |
Joint Completion and Alignment of Multilingual Knowledge Graphs (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for knowledge graph completion are incomplete, as curators struggle to keep up with the real world. |
| Approach: | They propose a multitask approach to solve missing facts in incomplete Knowledge Graphs . they add a relation representation to the existing KG embedding scheme . |
| Outcome: | The proposed system outperforms existing models in seven languages compared to existing models . it also outperformed existing models, underscoring the value of joint alignment and completion. |
GeoIndia: A Seq2Seq Geocoding Approach for Indian Addresses (2024.emnlp-industry)
Copied to clipboard
| Challenge: | a new geocoding system for Indian addresses addresses is needed for logistics, urban planning and location-based services. |
| Approach: | They propose a geocoding system for Indian addresses using hierarchical H3-cell prediction using a Seq2Seq framework. |
| Outcome: | The proposed system outperforms existing geocoding platforms in accuracy and reliability across multiple Indian states. |