Do Large Language Models Have “Emotion Neurons”? Investigating the Existence and Role (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations of LLMs' emotional capabilities have been criticized for not illuminating how emotion information is processed and represented within an LLM. |
| Approach: | They examine whether there are “emotion neurons” within large language models that selectively process and express certain emotions and what functional role they play. |
| Outcome: | The proposed model is based on the representative emotion theory of the six basic emotions and demonstrates that it is functionally significant to examine whether the prediction accuracy for a specific emotion decreases when the neurons are removed. |
Similar Papers
Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on neurons focus on emotion and rhetoric, neglecting their intrinsic connections. |
| Approach: | They propose a framework for fine-grained steering of emotion and rhetoric in large language models . they propose 'neuro-based' masking method that integrates multi-dimensional screening . |
| Outcome: | The proposed method achieves directed induction of non-target sentences and enhancement of emotion tasks via rhetoric neurons. |
Discovering and Causally Validating Emotion-Sensitive Neurons in Large Audio-Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Emotion is a central dimension of spoken communication, yet we lack a mechanistic account of how LALMs encode it internally. |
| Approach: | They propose to use emotion-sensitive neurons in large audio-language models to study their interpretations. |
| Outcome: | The proposed models show that they can be used to make decisions on emotion . the results show that the ESNs exhibit non-uniform clustering with partial cross-dataset transfer . |
Does Large Language Model Contain Task-Specific Neurons? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable capabilities in comprehensively handling various types of natural language processing (NLP) tasks. |
| Approach: | They propose a method for task-specific neuron localization based on Causal Gradient Variation with Special Tokens (CGVST) this method identifies task- specific neurons by concentrating on the most significant tokens during task processing, eliminating redundant tokens and minimizing interference from non-essential neurons. |
| Outcome: | The proposed method can locate task-specific neurons across eight public tasks. |
A Unified View on Emotion Representation in Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Recent studies show the presence of emotion concepts in the hidden state representations, but it’s unclear if the model has a robust representation consistent across different datasets. |
| Approach: | They propose a unified view to understand emotion representation in Large Language Models by experimenting with diverse datasets and prompts. |
| Outcome: | The proposed model can be interchanged between datasets with minimal impact on performance. |
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models (2024.acl-long)
Copied to clipboard
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
| Challenge: | Despite the impressive multilingual capabilities demonstrated by LLMs, the understanding of how these abilities develop and function remains nascent. |
| Approach: | They propose a novel detection method to pinpoint language-specific neurons within LLMs by selectively activating or deactivating these neurons. |
| Outcome: | The proposed method can “steer” the output language of LLMs by selectively activating or deactivating language-specific neurons. |
On Relation-Specific Neurons in Large Language Models (2025.emnlp-main)
Copied to clipboard
Yihong Liu, Runsheng Chen, Lea Hirlimann, Ahmad Dawar Hakimi, Mingyang Wang, Amir Hossein Kargaran, Sascha Rothe, François Yvon, Hinrich Schuetze
| Challenge: | In large language models, certain neurons can store distinct pieces of knowledge learned during pretraining. |
| Approach: | They hypothesize that relation-specific neurons detect relation in input text and guide generation involving such a relation. |
| Outcome: | The proposed model can handle facts involving relation r and facts containing a different relation . |
Lost in Activations: A Neuron-level Analysis of Encoders for Cross-Lingual Emotion Detection (2026.eacl-short)
Copied to clipboard
| Challenge: | XLM-R models for multilingual emotion classification are still lacking in understanding of their internal decision-making mechanisms. |
| Approach: | They propose to use neuron-level activation analysis to study the inter-language differences between neurons. |
| Outcome: | The proposed model consistently encodes emotion-related concepts across languages, but others show strong monolingual specialization. |
Mapping Brains with Language Models: A Survey (2023.findings-acl)
Copied to clipboard
| Challenge: | accumulated evidence for brain and language model activations remains ambiguous, but correlations with model size and quality provide grounds for cautious optimism. |
| Approach: | They examine the evidence accumulated by 30 studies spanning 10 datasets and 8 metrics to determine whether there is any overlap between brain and language model activations. |
| Outcome: | The findings suggest that representations extracted from NLP models can (partially) explain the signal found in neural data. |
The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Units (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have revealed their potential to perform far more than language processing tasks, showcasing abilities in reasoning and problem-solving. |
| Approach: | They identify language-selective units within 18 popular LLMs using the same localization approach that is used in neuroscience. |
| Outcome: | The proposed method shows that language-selective units are more aligned to brain recordings from the human language system than random units. |
On the Multilingual Ability of Decoder-based Pre-trained Language Models: Finding and Controlling Language-Specific Neurons (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing decoder-based pre-trained language models demonstrate excellent multilingual capabilities, but it is unclear how they handle multilingualism. |
| Approach: | They propose to examine the neuron-level internal behavior of decoder-based PLMs by finding neurons that fire “uniquely for each language” within decoded PLM models. |
| Outcome: | The proposed models fire “uniquely for each language” and show that language-specific neurons are unique, with a slight overlap (5%) between languages. |