Anatomy of a Feeling: Narrating Embodied Emotions via Large Vision-Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | ELENA is a framework for embodied emotion analysis using large vision language models . ELEna uses attention maps and a persistent bias towards the facial region . |
| Approach: | They propose a framework that utilizes large vision language models to generate ELENA . they propose to use attention maps to describe emotional reactions from body parts . |
| Outcome: | The proposed framework outperforms baseline models without fine-tuning . it uses large vision language models to generate embodied emotion narratives . |
Similar Papers
My Heart Skipped a Beat! Recognizing Expressions of Embodied Emotion in Natural Language (2024.naacl-long)
Copied to clipboard
| Challenge: | a new task is needed to recognize physical manifestations of emotions in natural language . physical manifestation of emotions affects not only our mental state but also our physical state . |
| Approach: | They propose a task to recognize expressions of embodied emotion in natural language . they use body part mentions with human annotations to extract emotional manner expressions . |
| Outcome: | The proposed model can train without gold data and improve performance with gold data. |
CHEER-Ekman: Fine-grained Embodied Emotion Classification (2025.acl-short)
Copied to clipboard
| Challenge: | Emotions manifest through physical experiences and bodily reactions, yet identifying such embodied emotions in text remains understudied. |
| Approach: | They propose to extend existing binary embodied emotion dataset with Ekman’s six basic emotion categories. |
| Outcome: | The proposed dataset outperforms existing methods with large language models. |
Evaluating Vision-Language Models for Emotion Recognition (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Vision-Language Models (VLMs) have been used for objective multimodal reasoning tasks for decades. |
| Approach: | They present a comprehensive evaluation of large vision-language models for recognizing evoked emotions from images. |
| Outcome: | The proposed model performs well in evoked emotion recognition task and is robust to human errors. |
Seeing is Believing: Emotion-Aware Audio-Visual Language Modeling for Expressive Speech Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | AVLM integrates full-face visual cues into a pre-trained expressive speech model. |
| Approach: | They propose an Audio-Visual Language Model (AVLM) for expressive speech generation by integrating full-face visual cues into a pre-trained expressive speech model. |
| Outcome: | The proposed model incorporates full-face visual cues into a pre-trained expressive speech model. |
A Unified View on Emotion Representation in Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Recent studies show the presence of emotion concepts in the hidden state representations, but it’s unclear if the model has a robust representation consistent across different datasets. |
| Approach: | They propose a unified view to understand emotion representation in Large Language Models by experimenting with diverse datasets and prompts. |
| Outcome: | The proposed model can be interchanged between datasets with minimal impact on performance. |
Modulating Language Models with Emotions (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating context-aware language that embodies diverse emotions are dull or generic due to limited training data for diverse emotions. |
| Approach: | They propose a modulated layer normalization technique that generates emotional responses using large pre-trained models. |
| Outcome: | The proposed method outperforms baseline methods on the MojiTalk dataset while maintaining diversity, fluency, and coherence. |
BQA: Body Language Question Answering Dataset for Video Large Language Models (2025.acl-short)
Copied to clipboard
| Challenge: | a large part of human communication relies on nonverbal cues such as facial expressions, eye contact, and body language. |
| Approach: | They propose to validate whether video large language models can correctly interpret body language from short clips of body language. |
| Outcome: | The proposed model can correctly interpret emotions from short clips of body language. |
Uncovering Bias in Large Vision-Language Models at Scale with Counterfactuals (2025.naacl-long)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. |
| Approach: | They propose large vision-Language Models to augment LLMs with visual inputs. |
| Outcome: | The proposed models condition generated text on both an input image and a visual prompt, enabling a variety of use cases such as visual question answering and multimodal chat. |
The Language of Interoception: Examining Embodiment and Emotion Through a Corpus of Body Part Mentions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | 5% to 10% of posts include body part mentions in English text . text containing BPMs tends to be more emotionally charged, even when the BPM is not used to describe a physical reaction to the emotion in the text. |
| Approach: | They create corpora of body part mentions in online English text with human annotations for the emotions of the person whose body part is mentioned. |
| Outcome: | The proposed study is the first to investigate the connection between emotion, embodiment, and everyday language in a large sample of natural language data. |
Emo3D: Metric and Benchmarking Dataset for 3D Facial Expression Generation from Emotion Description (2025.findings-naacl)
Copied to clipboard
Mahshid Dehghani, Amirahmad Shafiee, Ali Shafiei, Neda Fallah, Farahmand Alizadeh, Mohammad Mehdi Gholinejad, Hamid Behroozi, Jafar Habibi, Ehsaneddin Asgari
| Challenge: | Existing 3D facial emotion modeling models are constrained by limited emotion classes and insufficient datasets. |
| Approach: | They propose a 3D facial emotion modeling dataset that spans a wide spectrum of human emotions . they use large language models to generate a diverse array of textual descriptions . |
| Outcome: | Emo3D is an extensive dataset that spans human emotions with images and 3D blendshapes. |