Papers by Shreya Jain
Counter Turing Test (CT2): AI-Generated Text Detection is Not as Easy as You May Think - Introducing AI Detectability Index (ADI) (2023.emnlp-main)
Copied to clipboard
Megha Chakraborty, S.M Towhidul Islam Tonmoy, S M Mehedi Zaman, Shreya Gautam, Tanay Kumar, Krish Sharma, Niyar Barman, Chandan Gupta, Vinija Jain, Aman Chadha, Amit Sheth, Amitava Das
| Challenge: | a number of issues have arisen regarding the risk and consequences of AI-generated text detection. |
| Approach: | They propose a counter-turing test to evaluate the robustness of existing AGTD methods . they propose ADI, a quantifiable spectrum to assess detectability of LLMs . |
| Outcome: | The proposed method evaluates the robustness of existing AGTD methods . it shows that larger LLMs tend to have lower ADI, indicating they are less detectable . |
Towards Robust Knowledge Representations in Multilingual LLMs for Equivalence and Inheritance based Consistent Reasoning (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models have led to impressive linguistic capabilities and emergent reasoning behaviors. |
| Approach: | They propose to use "equivalence" and "inheritance" to evaluate LLMs' representations . they propose to combine "equal" and 'inheritory' to improve consistency across languages . |
| Outcome: | The proposed representations show that they produce conflicting answers across languages . the proposed representation improves performance across languages and improves learning and knowledge sharing. |
SEPSIS: I Can Catch Your Lies – A New Paradigm for Deception Detection (2025.acl-srw)
Copied to clipboard
Anku Rani, Dwip Dalal, Shreya Gautam, Pankaj Gupta, Vinija Jain, Aman Chadha, Amit Sheth, Amitava Das
| Challenge: | a new framework categorizes deception into three forms: lies of omission, lies of commission, and lies of influence . a novel framework for deception detection leveraging NLP techniques is proposed . |
| Approach: | They propose a framework that categorizes deception into three forms: lies of omission, lies of commission, and lies of influence. |
| Outcome: | The proposed framework achieves an impressive F1 score of 0.87 across all layers . it can be used to investigate lies of omission, lies of commission and lies of influence . |
Intent Detection in the Age of LLMs (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Traditional approaches to intent detection struggle with out-of-scope (OOS) detection. |
| Approach: | They propose to use adaptive in-context learning and chain-of-thought prompting to detect intent in SOTA LLMs. |
| Outcome: | The proposed system achieves 2% of native accuracy with 50% less latency. |