A Study on the Ambiguity in Human Annotation of German Oral History Interviews for Perceived Emotion Recognition and Sentiment Analysis (2022.lrec-1)
Copied to clipboard
Michael Gref, Nike Matthiesen, Sreenivasa Hikkal Venugopala, Shalaka Satheesh, Aswinkumar Vijayananth, Duc Bach Ha, Sven Behnke, Joachim Köhler
| Challenge: | Sentiment analysis and emotion recognition can help research in audiovisual interview archives . however, humans perceive sentiments and emotions ambiguously and subjectively . |
| Approach: | They investigate human perceptions of emotions and sentiments in oral history interviews . they show that human perception for different emotions is ambiguous and subjective . authors propose deep learning as a way to categorize and search emotions . |
| Outcome: | The proposed techniques can be used to search and index audiovisual interviews . the authors show that human perceptions differ for different emotions . |
Similar Papers
Improved Transcription and Indexing of Oral History Interviews for Digital Humanities Research (L18-1)
Copied to clipboard
| Challenge: | Existing methods to improve transcription and indexing quality of Oral History interviews are not available. |
| Approach: | They propose to use a German Oral History test-set to improve transcription and indexing quality . they propose to combine acoustic modeling techniques with sophisticated neural networks . |
| Outcome: | The proposed system reduces word error rate by 28.3% on German Oral History test-set compared to baseline system . the Fraunhofer IAIS Audio Mining system can process long audio-files to automatically create time-aligned transcriptions. |
Annotation of Emotion Carriers in Personal Narratives (2020.lrec-1)
Copied to clipboard
| Challenge: | PNs are recollections of facts, events, and thoughts that are best explained by speech or text segments . spoken PN is difficult because it is unstructured and involving multiple sub-events and characters as well as thoughts and associated emotions perceived by the narrator. |
| Approach: | They propose and evaluate an annotation model for identifying emotion carriers in spoken personal narratives from the Ulm State-of-Mind in Speech corpus. |
| Outcome: | The proposed model could be used to extract emotion carriers from spoken personal narratives, which are often unstructured and often unorganized . |
PO-EMO: Conceptualization, Annotation, and Modeling of Aesthetic Emotions in German and English Poetry (2020.lrec-1)
Copied to clipboard
| Challenge: | a new study shows that literature enables engagement in a broader range of complex and subtle emotions. |
| Approach: | They propose to use multiple emotion labels to capture mixed emotions in poetry . they evaluate an annotation experiment with experts and crowdsourcing . |
| Outcome: | The proposed method shows that identifying aesthetic emotions is challenging in the German subset. |
Handling Ambiguity in Emotion: From Out-of-Domain Detection to Distribution Estimation (2024.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that incorporating utterances without majority-agreed labels into an additional class reduces the classification performance of the other emotion classes. |
| Approach: | They propose to combine utterances without majority-agreed labels into an additional class . they propose to quantify uncertainty in emotion classification using evidential deep learning . |
| Outcome: | The proposed method retains classification accuracy while effectively detects ambiguous emotion expressions. |
Automatic Orality Identification in Historical Texts (2020.lrec-1)
Copied to clipboard
| Challenge: | a set of general linguistic features are used to identify conceptually-oral historical texts . linguists recognize that there is also a lot of variation within discourse modes . |
| Approach: | They propose to use general linguistic features to identify conceptually-oral historical texts . they find they are useful for determining conceptuality of historical data as for modern data . |
| Outcome: | The proposed features are used to identify conceptually-oral historical German texts . the features are useful in determining conceptuality of historical data as they are for modern data . |
A Comparative Cross Language View On Acted Databases Portraying Basic Emotions Utilising Machine Learning (2022.lrec-1)
Copied to clipboard
| Challenge: | Since several decades emotional databases have been recorded by various laboratories. |
| Approach: | They propose to model similarity as performance in cross database machine learning experiments and to analyze a manually picked set of four acoustic features that represent different phonetic areas. |
| Outcome: | The proposed sets of features represent different phonetic areas and are comparable across languages. |
Disentangling Subjectivity and Uncertainty for Hate Speech Annotation and Modeling using Gaze (2025.emnlp-main)
Copied to clipboard
Özge Alacam, Sanne Hoeken, Andreas Säuberli, Hannes Gröner, Diego Frassinelli, Sina Zarrieß, Barbara Plank
| Challenge: | Variation is inherent in opinion-based annotation tasks like sentiment or hate speech analysis. |
| Approach: | They propose to use annotators' confidence ratings to disentangle subjective variation from uncertainty without relying on specific features present in the data. |
| Outcome: | The proposed approach shows that human gaze patterns offer valuable indicators of subjective evaluation and uncertainty. |
Evaluating Emotion Arcs Across Languages: Bridging the Global Divide in Sentiment Analysis (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Emotion arcs capture how an individual (or a population) feels over time. |
| Approach: | They compare machine-learning and Lexicon-Only methods to generate emotion arcs . they run experiments on 18 diverse datasets in 9 languages . |
| Outcome: | The proposed method is poor at instance level emotion classification, but highly accurate when aggregating information from hundreds of instances. |
Role-Guided Annotation and Prototype-Aligned Representation Learning for Historical Literature Sentiment Classification (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work focused on using sentiment lexicons or leveraging large language models for annotation . lexiconics are often unavailable for historical texts due to limited linguistic resources . |
| Approach: | They propose a role-guided annotation strategy that prompts LLMs to simulate historical perspectives when labeling sentiment. |
| Outcome: | The proposed method outperforms state-of-the-art baselines across historical literature datasets. |
DENS: A Dataset for Multi-class Emotion Analysis (D19-1)
Copied to clipboard
| Challenge: | Existing sentence-level methods for emotion analysis are limited by the number of words in tweets and product reviews. |
| Approach: | They introduce a dataset for multi-class emotion analysis from long-form narratives in English . they use classic literature and modern online narratives available on Wattpad . |
| Outcome: | The proposed dataset provides a novel opportunity for emotion analysis that requires moving beyond sentence-level techniques. |