Papers by Patrizia Paggio
Dialogue Act Annotation in a Multimodal Corpus of First Encounter Dialogues (2020.lrec-1)
Copied to clipboard
| Challenge: | a method used to annotate dialogue acts in a multimodal corpus is described . the annotations allow for analysis of how multimodal signals contribute to the structure and content of the dialogues. |
| Approach: | They propose to annotate dialogue acts in a multimodal corpus of first encounter dialogues . they focus on which dialogue acts often follow each other across speakers and which overlap gestural behaviour . |
| Outcome: | The method used to annotate dialogue acts in a multimodal corpus is described. |
Multimodal Behaviour in an Online Environment: The GEHM Zoom Corpus Collection (2024.lrec-main)
Copied to clipboard
| Challenge: | Several studies have discussed pros and cons of videoconferencing for group meetings, international conference organisation and teaching. |
| Approach: | They propose to use 12 video recordings of Zoom meetings held in English by an international group of researchers from September 2021 to March 2023 to study group communication in a reallife setting. |
| Outcome: | The proposed corpus was developed under the auspices of the international network on Gesture and Head Movement in Language (GEHM) it shows that the participants' speech transcription and visual keypoint values can be visualised to see how gestural behaviour supports feedback words during the interaction. |
Classifying the Informative Behaviour of Emoji in Microblogs (L18-1)
Copied to clipboard
| Challenge: | Emoji are pictographs used in microblogs as emotion markers, but can also represent a wider range of concepts. |
| Approach: | They analyze a corpus of tweets pairs and classify emoji with respect to redundancy . they propose to further investigate the informative behaviour of e-mails using eoji . |
| Outcome: | The proposed model achieved an F-score of 0.7 for emoji use in 2475 tweets pairs. |
Face2Text: Collecting an Annotated Image Description Corpus for the Generation of Rich Face Descriptions (L18-1)
Copied to clipboard
Albert Gatt, Marc Tanti, Adrian Muscat, Patrizia Paggio, Reuben A Farrugia, Claudia Borg, Kenneth P Camilleri, Michael Rosner, Lonneke van der Plas
| Challenge: | a crowdsourcing study has been conducted to generate rich textual descriptions of human faces . the aim is to investigate how users describe images of human face images . |
| Approach: | They propose to extend the problem of automatically generating text from images to face description . they conducted an annotation study on a subset of the corpus to gain a better understanding of the variation they find in face descriptions . |
| Outcome: | The proposed corpus is based on images taken in the wild and is expected to be large enough to support non-trivial machine learning work on the automated description of faces. |
Letters From the Past: Modeling Historical Sound Change Through Diachronic Character Embeddings (2022.acl-long)
Copied to clipboard
| Challenge: | a great deal of work has been done on NLP approaches to lexical semantic change detection, but other aspects of language change have received less attention from the NLP community. |
| Approach: | They propose to compare the relative distance through time between the distributions of the characters involved before and after a sound change has taken place. |
| Outcome: | The proposed method can trace the well-known historical change of lenition of plosives in Danish historical sources and identify several of the changes under consideration and uncover meaningful contexts in which they appeared. |