LLaMAs Have Feelings Too: Unveiling Sentiment and Emotion Representations in LLaMA Models Through Probing (2025.acl-long)
Copied to clipboard
Dario Di Palma, Alessandro De Bellis, Giovanni Servedio, Vito Walter Anelli, Fedelucio Narducci, Tommaso Di Noia
| Challenge: | Large Language Models (LLMs) have become central to NLP, demonstrating their ability to adapt to various tasks through prompting techniques. |
| Approach: | They probe the hidden layers of Large Language Models to identify where sentiment features are most represented and to assess how this affects sentiment analysis. |
| Outcome: | The proposed approach enables sentiment tasks to be performed with memory requirements reduced by an average of 57%. |
Similar Papers
Uncovering Sentiment Analysis Circuit in Large Language Model (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work has shown that sentiment is encoded linearly in LLM representations, but their ability to utilize this information remains fragile to prompt variations. |
| Approach: | They propose a simple inference-time intervention method that amplifies circuit features to compensate for insufficient activation. |
| Outcome: | The proposed method improves on a sentiment analysis circuit with sparse autoencoders and circuit-level analysis. |
A Unified View on Emotion Representation in Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Recent studies show the presence of emotion concepts in the hidden state representations, but it’s unclear if the model has a robust representation consistent across different datasets. |
| Approach: | They propose a unified view to understand emotion representation in Large Language Models by experimenting with diverse datasets and prompts. |
| Outcome: | The proposed model can be interchanged between datasets with minimal impact on performance. |
Sentiment Analysis in the Era of Large Language Models: A Reality Check (2024.findings-naacl)
Copied to clipboard
| Challenge: | Sentiment analysis (SA) has been a long-standing research area in natural language processing. |
| Approach: | They propose a benchmark to evaluate LLMs' SA abilities and propose 'sentiEval' benchmark to be used for a more comprehensive evaluation. |
| Outcome: | The proposed benchmark outperforms small language models on 26 datasets on 13 tasks and compared them with LLMs trained on domain-specific datasets. |
How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on enhancing the factualness of large language models using context knowledge. |
| Approach: | They propose to use ChatGPT to construct probing datasets that provide diverse and coherent evidence corresponding to various facts. |
| Outcome: | The proposed model can encode knowledge across different layers, and it is compared with existing models. |
Where do LLMs Encode the Knowledge to Assess the Ambiguity? (2025.coling-industry)
Copied to clipboard
| Challenge: | False sizing of large language models can generate unreliable responses . |
| Approach: | They propose a method to train large language models without ambiguity labels . |
| Outcome: | The proposed method detects ambiguous input prompts better than representations from the final layer. |
Dissecting Persona-Driven Reasoning in Language Models via Activation Patching (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) exhibit remarkable versatility in adopting diverse personas. |
| Approach: | They examine how assigning a persona influences a model’s reasoning on an objective task by activation patching . |
| Outcome: | The early Multi-Layer Perceptron (MLP) layers attend to syntactic structure of input and process its semantic content. |
Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on neurons focus on emotion and rhetoric, neglecting their intrinsic connections. |
| Approach: | They propose a framework for fine-grained steering of emotion and rhetoric in large language models . they propose 'neuro-based' masking method that integrates multi-dimensional screening . |
| Outcome: | The proposed method achieves directed induction of non-target sentences and enhancement of emotion tasks via rhetoric neurons. |
Mechanistic Interpretability of Emotion Inference in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on large language models (LLMs) show promising capabilities in predicting human emotions from text. |
| Approach: | They investigate how autoregressive LLMs infer emotions by focusing on appraisal theory . they show that emotion representations are functionally localized to specific regions in the model . |
| Outcome: | The proposed model is functionally localized to specific regions in the model, and the results align with theoretical and intuitive expectations. |
Beyond Silent Letters: Amplifying LLMs in Emotion Recognition with Vocal Nuances (2025.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that Large Language Models possess a form of emotional intelligence, capable of interpreting emotional stimuli in text. |
| Approach: | They propose a method that translates speech characteristics into natural language descriptions and integrates them into LLMs to perform multimodal emotion analysis via text prompts. |
| Outcome: | The proposed method outperforms baseline models that require structural modifications on two datasets showing significant improvements in emotion recognition accuracy. |
Do Large Language Models Have “Emotion Neurons”? Investigating the Existence and Role (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations of LLMs' emotional capabilities have been criticized for not illuminating how emotion information is processed and represented within an LLM. |
| Approach: | They examine whether there are “emotion neurons” within large language models that selectively process and express certain emotions and what functional role they play. |
| Outcome: | The proposed model is based on the representative emotion theory of the six basic emotions and demonstrates that it is functionally significant to examine whether the prediction accuracy for a specific emotion decreases when the neurons are removed. |