Adding Gesture, Posture and Facial Displays to the PoliModal Corpus of Political Interviews (2020.lrec-1)
Copied to clipboard
| Challenge: | a corpus of face-to-face interviews is annotated with facial displays, hand gestures and body posture. |
| Approach: | They introduce a multimodal corpus on top of transcribed face-to-face interviews that presents the annotation of facial displays, hand gestures and body posture. |
| Outcome: | The proposed corpus is extracted from a larger corpus of 56 face-to-face interviews (14 hours) the annotations include facial displays, hand gestures and body posture. |
Similar Papers
Dialogue Act Annotation in a Multimodal Corpus of First Encounter Dialogues (2020.lrec-1)
Copied to clipboard
| Challenge: | a method used to annotate dialogue acts in a multimodal corpus is described . the annotations allow for analysis of how multimodal signals contribute to the structure and content of the dialogues. |
| Approach: | They propose to annotate dialogue acts in a multimodal corpus of first encounter dialogues . they focus on which dialogue acts often follow each other across speakers and which overlap gestural behaviour . |
| Outcome: | The method used to annotate dialogue acts in a multimodal corpus is described. |
The POTUS Corpus, a Database of Weekly Addresses for the Study of Stance in Politics and Virtual Agents (2020.lrec-1)
Copied to clipboard
| Challenge: | Embodied Conversational Agents (ECAs) are used to generate socially believable agents. |
| Approach: | They propose to use audio-video files of political addresses to generate a corpus of socially believable agents which can be annotated by external observers. |
| Outcome: | The proposed corpus analyzes audio-video files of political addresses to the american people and provides the same speeches given by a virtual agent named Rodrigue. |
Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel’s Weekly Video Podcasts (2022.lrec-1)
Copied to clipboard
| Challenge: | a dataset of 16 years of (almost) weekly Internet podcasts of former german chancellor Angela Merkel is presented. |
| Approach: | They propose to curate a German podcast corpus from 16 years of podcasts of former german chancellor Angela Merkel using audio-visual-text methods. |
| Outcome: | The proposed pipeline can be used to curate other datasets of similar nature, such as talk show contents. |
The Automatic Annotation of the Semiotic Type of Hand Gestures in Obama’ s Humorous Speeches (L18-1)
Copied to clipboard
| Challenge: | Existing studies on hand gestures from video-recorded speeches have not identified them. |
| Approach: | They annotated and analysed hand gestures produced by Barack Obama . they trained machine learning algorithms to classify the semiotic type of hand gesture . |
| Outcome: | The proposed method can be used to classify hand gestures on video-recorded speeches and in advanced multimodal interactive systems. |
Praaline: An Open-Source System for Managing, Annotating, Visualising and Analysing Speech Corpora (P18-4)
Copied to clipboard
| Challenge: | Praaline is an open-source software system for constituting and managing spoken language and multimodal corpora. |
| Approach: | They present the latest developments of Praaline, an open-source software system for constituting and managing spoken language and multimodal corpora. |
| Outcome: | The proposed system can be used for creating, managing, visualising and analysing spoken language and multimodal corpora. |
Modeling Collaborative Multimodal Behavior in Group Dialogues: The MULTISIMO Corpus (L18-1)
Copied to clipboard
| Challenge: | a corpus of human-computer interactions recorded in multiple modalities is being developed to study and model collaborative aspects of multimodal behavior in groups. |
| Approach: | They propose to use a multimodal corpus to investigate collaborative aspects of multimodal behavior in groups that perform simple tasks. |
| Outcome: | The proposed corpus is designed for public release and includes survey materials, personality tests and experience assessment questionnaires filled in by all participants. |
Multimodal Corpus of Bidirectional Conversation of Human-human and Human-robot Interaction during fMRI Scanning (2020.lrec-1)
Copied to clipboard
Birgit Rauchbauer, Youssef Hmamouche, Brigitte Bigi, Laurent Prévot, Magalie Ochs, Thierry Chaminade
| Challenge: | a study of real-life bi-directional conversations combines multimodal corpus with neural, physiological and behavioral data. |
| Approach: | They propose a multimodal corpus derived from natural conversations . they used human-human interactions as a control condition . |
| Outcome: | The proposed corpus includes neural, physiological and behavioral data. |
The GermaParl Corpus of Parliamentary Protocols (L18-1)
Copied to clipboard
| Challenge: | Parliamentary debates convey the arguments, interpretations and disputes that shape political decision-making. |
| Approach: | They outline available data, the data preparation process for preparing corpora of parliamentary debates and tools to obtain hand-coded annotations. |
| Outcome: | The proposed corpus provides a valuable resource for research and teaching purposes. |
A Multimodal Educational Corpus of Oral Courses: Annotation, Analysis and Case Study (2020.lrec-1)
Copied to clipboard
Salima Mdhaffar, Yannick Estève, Antoine Laurent, Nicolas Hernandez, Richard Dufour, Delphine Charlet, Geraldine Damnati, Solen Quiniou, Nathalie Camelin
| Challenge: | a corpus of spontaneous speech is being developed for educational use . the dataset will be freely available to the research community . |
| Approach: | They propose to use a French speech educational corpus to explore synchronous speech transcription and application in teaching situations. |
| Outcome: | The proposed corpus includes 10 hours of lectures, manually transcribed and segmented . the dataset will be freely available to the research community . |
Wikinflection Corpus: A (Better) Multilingual, Morpheme-Annotated Inflectional Corpus (2020.lrec-1)
Copied to clipboard
| Challenge: | Inflectional corpora with annotated morpheme boundaries are scarce in the NLP community . a generated, multilingual inflectional lexicon with morphological features is not as good as UniMorph's . |
| Approach: | They evaluate a multilingual inflectional corpus with morpheme boundaries from the English Wiktionary and the UniMorph project's inflection corpus. |
| Outcome: | The generated Wikinflection corpus is not as good as UniMorph's, but extracts significant amount of words from the intersection of the two corpora. |