Papers by Costanza Navarretta
Dialogue Act Annotation in a Multimodal Corpus of First Encounter Dialogues (2020.lrec-1)
Copied to clipboard
| Challenge: | a method used to annotate dialogue acts in a multimodal corpus is described . the annotations allow for analysis of how multimodal signals contribute to the structure and content of the dialogues. |
| Approach: | They propose to annotate dialogue acts in a multimodal corpus of first encounter dialogues . they focus on which dialogue acts often follow each other across speakers and which overlap gestural behaviour . |
| Outcome: | The method used to annotate dialogue acts in a multimodal corpus is described. |
The Subject Annotations of the Danish Parliament Corpus (2009-2017) - Evaluated with Automatic Multi-label Classification (2022.lrec-1)
Copied to clipboard
| Challenge: | The interest in analysing and automatically processing large amounts of political data has increased in the past decades. |
| Approach: | They address the semi-automatic annotation of subjects in the Danish Parliament Corpus (2009-2017) v.2 and describe multi-label classification experiments to verify the consistency of the subject annotation. |
| Outcome: | The proposed method improves on the baseline classifier, which is a majority classifier. |
The Automatic Annotation of the Semiotic Type of Hand Gestures in Obama’ s Humorous Speeches (L18-1)
Copied to clipboard
| Challenge: | Existing studies on hand gestures from video-recorded speeches have not identified them. |
| Approach: | They annotated and analysed hand gestures produced by Barack Obama . they trained machine learning algorithms to classify the semiotic type of hand gesture . |
| Outcome: | The proposed method can be used to classify hand gestures on video-recorded speeches and in advanced multimodal interactive systems. |
Creating a Corpus of Gestures and Predicting the Audience Response based on Gestures in Speeches of Donald Trump (2020.lrec-1)
Copied to clipboard
| Challenge: | a study aims to explore the role of speech pauses and gestures alone as predictors of audience reaction without other types of speech information. |
| Approach: | They analyze two speeches by Barack Obama and use them to predict audience reaction . they find that long pauses and co-speech gestures alone predict audience response . |
| Outcome: | The proposed models can predict audience reaction without other types of speech information. |
Multimodal Behaviour in an Online Environment: The GEHM Zoom Corpus Collection (2024.lrec-main)
Copied to clipboard
| Challenge: | Several studies have discussed pros and cons of videoconferencing for group meetings, international conference organisation and teaching. |
| Approach: | They propose to use 12 video recordings of Zoom meetings held in English by an international group of researchers from September 2021 to March 2023 to study group communication in a reallife setting. |
| Outcome: | The proposed corpus was developed under the auspices of the international network on Gesture and Head Movement in Language (GEHM) it shows that the participants' speech transcription and visual keypoint values can be visualised to see how gestural behaviour supports feedback words during the interaction. |
Evaluating Word Expansion for Multilingual Sentiment Analysis of Parliamentary Speech (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent efforts to create and format data sets of parliamentary speech material have facilitated cross-lingual comparisons and highlighted the need for methods that are computationally efficient and language-agnostic. |
| Approach: | They propose a word expansion method for sentiment lexicon generation that leverages word embeddings and vector similarity to expand synonym seed lists with domain-specific terms from the speech corpora. |
| Outcome: | The proposed method is compared with other multilingual lexica and is highly sensitive to processing and scoring techniques. |