Challenge: Using deep neural networks, task-oriented dialogue systems can be used to generate an appropriate response to users' inputs.
Approach: They collected a multimodal dialogue corpus with a wide range of speaker ages and set up a dialogue task based on travel . results suggest adult speakers have more independent opinions, older speakers express opinions more frequently compared with other age groups, and operators expressed a smile more frequently to minor speakers.
Outcome: The results show that adult speakers have more independent opinions, the older speakers express their opinions more frequently compared with other age groups, and the operators expressed a smile more frequently to the minor speakers.

Similar Papers

Fora: A corpus and framework for the study of facilitated dialogue (2024.acl-long)

Copied to clipboard

Challenge: a new study of facilitated dialogues focuses on the sharing of personal experience . social media is a popular method of civic engagement but lacks the tools to analyze it .
Approach: They compile 262 facilitated conversations hosted with partner organizations . they taxonomize personal sharing behaviors and facilitation strategies in the corpus .
Outcome: The proposed framework can be used to analyze facilitated dialogues and parse spoken conversations . the data can be applied to other fields, including civic use in governance and social science .
Construction and Analysis of a Multimodal Chat-talk Corpus for Dialog Systems Considering Interpersonal Closeness (2020.lrec-1)

Copied to clipboard

Challenge: a large-scale multimodal dialog corpus is needed to accelerate research on dialog systems that can handle social signals and verbal information.
Approach: They construct a multimodal dialog corpus focusing on the relationship between speakers and 19 pairs of participants.
Outcome: The proposed system is based on a multimodal dialog corpus of 19,303 utterances (10 hours) from 19 pairs of participants.
Annotation and Quantitative Analysis of Speaker Information in Novel Conversation Sentences in Japanese (L18-1)

Copied to clipboard

Challenge: a qualitative lexicological analysis of conversation sentences in novels is performed . gender and age of conversation sentence information is not used as actual speech .
Approach: They performed a quantitative lexicological analysis using attributed speaker information . they also examined the differences between Japanese novels and translations of foreign novels .
Outcome: The results show that conversation sentences in novels are representative of spoken language . the authors conclude that conversation sentence data are not useful as speech materials .
In Search of the Lost Arch in Dialogue: A Dependency Dialogue Acts Corpus for Multi-Party Dialogues (2025.findings-acl)

Copied to clipboard

Challenge: Understanding speaker intentions remains a challenge in NLP . a number of corpora annotated using theoretical frameworks of dialogue focus on utterance-level labeling of speaker intent, missing wider context, or the rhetorical structure of a dialogue.
Approach: They propose to annotate a corpus of 33 dialogues and over 9,000 utterance units using the Dependency Dialogue Acts framework.
Outcome: The proposed corpus spans four genres of multi-party conversations from different modalities.
A Brief Survey of Textual Dialogue Corpora (2022.lrec-1)

Copied to clipboard

Challenge: Several dialogue corpora are available for research purposes, but they do not cover all the necessities of real-world applications.
Approach: They analyze available dialogue corpora and propose possible approaches to create new ones.
Outcome: The proposed corpus of human-human dialogues is based on a list of available dialogue corpora . it covers speakers, size, languages, collection, annotations, and domains . some trends are identified and possible approaches are also discussed .
Collection of Multimodal Dialog Data and Analysis of the Result of Annotation of Users’ Interest Level (L18-1)

Copied to clipboard

Challenge: a group of researchers is building a corpus for evaluating elements of multimodal dialogue systems.
Approach: They propose to build a corpus for evaluating elements of the multimodal dialogue system . they use the Wizard of Oz method to record chat dialogue data between a human and a virtual agent .
Outcome: The proposed method annotates chat dialogue data between a human and a virtual agent and measures their interest level in the data.
Do LLMs Understand Dialogues? A Case Study on Dialogue Acts (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable performance on many unseen tasks in a zero-shot setting.
Approach: They propose to identify three key pre-tasks essential for accurate DA prediction: Turn Management, Communicative Function Identification, and Dialogue Structure Prediction.
Outcome: The proposed model fails to outperform basic rule-based tasks on three key pre-tasks, and the results suggest that the model is flawed.
Dialogue Act Annotation in a Multimodal Corpus of First Encounter Dialogues (2020.lrec-1)

Copied to clipboard

Challenge: a method used to annotate dialogue acts in a multimodal corpus is described . the annotations allow for analysis of how multimodal signals contribute to the structure and content of the dialogues.
Approach: They propose to annotate dialogue acts in a multimodal corpus of first encounter dialogues . they focus on which dialogue acts often follow each other across speakers and which overlap gestural behaviour .
Outcome: The method used to annotate dialogue acts in a multimodal corpus is described.
MULTICOLLAB: A Multimodal Corpus of Dialogues for Analyzing Collaboration and Frustration in Language (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to study complex emotions when a speaker collaborates with a partner are limited.
Approach: They propose to fuse a multimodal dialogue resource with transcribed speech and eye gaze data to create a highly multimodal corpus.
Outcome: The proposed model improves classification accuracy by 21% over baseline using sensor and speech data in 4.5 seconds.
Getting To Know You: User Attribute Extraction from Dialogues (2020.lrec-1)

Copied to clipboard

Challenge: a new method to extract user attributes from dialogues is needed to improve user understanding.
Approach: They propose to leverage dialogues with conversational agents to automatically extract user attributes from dialogues.
Outcome: The proposed model surpasses retrieval and generation baselines on human evaluation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations