Papers by Nikita Soni
Evaluation of LLMs-based Hidden States as Author Representations for Psychological Human-Centered NLP Tasks (2025.findings-naacl)
Copied to clipboard
| Challenge: | Many human-centered NLP tasks focus on assessing human-attributes of a user based on their language. |
| Approach: | They evaluate different ways of representing documents and users using different LM and HuLM architectures to predict task outcomes as dynamically changing states and averaged trait-like user-level attributes. |
| Outcome: | The proposed representations predict valence, arousal, empathy, and distress as well as trait-like user-level attributes. |
Human Language Modeling (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing language modeling models treat text sequences as if they were created independently. |
| Approach: | They propose a hierarchical extension to the language modeling problem whereby a human-level exists to connect sequences of documents and capture the notion that human language is moderated by changing human states. |
| Outcome: | The proposed model outperforms the current state-of-the-art in terms of language modeling and fine-tuning for 4 downstream tasks spanning document- and user-levels. |
Residualized Similarity for Faithfully Explainable Authorship Verification (2025.findings-emnlp)
Copied to clipboard
Peter Zeng, Pegah Alipoormolabashi, Jihu Mun, Gourab Dey, Nikita Soni, Niranjan Balasubramanian, Owen Rambow, H. Schwartz
| Challenge: | Neural methods achieve high accuracy, but their representations lack direct interpretability. |
| Approach: | They propose a method that supplements systems using interpretable features with a neural network to improve their performance while maintaining interpretability. |
| Outcome: | The proposed method improves the performance of state-of-the-art models while maintaining interpretability. |
MeLT: Message-Level Transformer with Masked Document Representations as Pre-Training for Stance Detection (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Much of natural language processing is focused on leveraging large capacity language models, typically trained over single messages with a task of predicting one or more tokens. |
| Approach: | They propose a hierarchical message-encoder pre-trained over Twitter for stance prediction task. |
| Outcome: | The proposed model achieves 67% performance on stance prediction task using a pre-trained message-encoder over Twitter. |
Large Human Language Models: A Need and the Challenges (2024.naacl-long)
Copied to clipboard
| Challenge: | a growing recognition of the importance of modeling human and social factors into human-centered NLP models . authors advocate for three positions toward creating large human language models based on psychological and behavioral sciences . |
| Approach: | et al. advocate for three positions toward creating large human language models . they argue that LM training should include the human context and recognize that people are more than their group . |
| Outcome: | a new study shows that learning language from linguistic signals alone is not adequate, according to a recent paper . authors advocate for three positions toward creating large human language models . a human-centered model should include the human context, and account for the dynamic nature of the human environment, they say . |
Systematic Evaluation of Auto-Encoding and Large Language Model Representations for Capturing Author States and Traits (2025.findings-acl)
Copied to clipboard
Khushboo Singh, Vasudha Varadarajan, Adithya V Ganesan, August Håkan Nilsson, Nikita Soni, Syeda Mahwish, Pranav Chitale, Ryan L. Boyd, Lyle Ungar, Richard N Rosenthal, H. Schwartz
| Challenge: | Large Language Models (LLMs) are increasingly used in human-centered applications, yet their ability to model diverse psychological constructs is not well understood. |
| Approach: | They evaluated a range of Transformer-LMs to predict psychological variables across five major dimensions: affect, substance use, mental health, sociodemographics, and personality. |
| Outcome: | The models predict affect, substance use, mental health, sociodemographics, and personality across five major dimensions. |
From Text to Context: Contextualizing Language with Humans, Groups, and Communities for Socially Aware NLP (2024.naacl-tutorials)
Copied to clipboard
Adithya V Ganesan, Siddharth Mangalik, Vasudha Varadarajan, Nikita Soni, Swanie Juhng, João Sedoc, H. Andrew Schwartz, Salvatore Giorgi, Ryan L Boyd
| Challenge: | This tutorial will cover the latest techniques and libraries for doing so at each level of analysis. |
| Approach: | This tutorial will cover the latest techniques and libraries for doing so at each level of analysis. |
| Outcome: | The tutorial covers human-centered techniques that provide benefit to traditional document- or word-level NLP tasks. |