Papers with Wizard-of-Oz
ScoutBot: A Dialogue System for Collaborative Navigation (P18-4)
Copied to clipboard
Stephanie M. Lukin, Felix Gervits, Cory J. Hayes, Pooja Moolchandani, Anton Leuski, John G. Rogers III, Carlos Sanchez Amaro, Matthew Marge, Clare R. Voss, David Traum
| Challenge: | Demo will allow users to issue unconstrained spoken language commands to ScoutBot. |
| Approach: | The demonstration will allow users to issue unconstrained spoken language commands to ScoutBot. |
| Outcome: | The demonstration will allow users to issue unconstrained spoken language commands to ScoutBot. |
How Users React to Proactive Voice Assistant Behavior While Driving (2020.lrec-1)
Copied to clipboard
| Challenge: | Nowadays Personal Assistants (PAs) are available in multiple environments and become increasingly popular to use via voice. |
| Approach: | They conducted a usability study in which 42 participants perceive proactive voice output in a Wizard-of-Oz study in . traffic density was varied during a highway drive and it included six in-car-specific use cases. |
| Outcome: | The proposed suggestions should not be obtrusive nor increase drivers’ cognitive load, while enhancing user experience. |
CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases (D19-1)
Copied to clipboard
Tao Yu, Rui Zhang, Heyang Er, Suyi Li, Eric Xue, Bo Pang, Xi Victoria Lin, Yi Chern Tan, Tianze Shi, Zihan Li, Youxuan Jiang, Michihiro Yasunaga, Sungrok Shim, Tao Chen, Alexander Fabbri, Zifan Li, Luyao Chen, Yuwen Zhang, Shreya Dixit, Vincent Zhang, Caiming Xiong, Richard Socher, Walter Lasecki, Dragomir Radev
| Challenge: | CoSQL is a corpus for building cross-domain, general-purpose database querying dialogue systems. |
| Approach: | They present a corpus for building cross-domain, general-purpose database querying dialogue systems . they use a Wizard-of-Oz collection of 3k turns plus 10k+ annotated SQL queries . |
| Outcome: | The proposed corpus is based on a Wizard-of-Oz dataset of 3k dialogues querying 200 complex DBs spanning 138 domains. |
Recognizing Behavioral Factors while Driving: A Real-World Multimodal Corpus to Monitor the Driver’s Affective State (L18-1)
Copied to clipboard
| Challenge: | Existing studies on the induced emotional states of the driver in a car have not been published. |
| Approach: | They used three sensor systems to collect emotional multimodal data while driving . they defined neutral, positive, frustrated and anxious states of the driver . |
| Outcome: | The collected data were analyzed using a Wizard-of-Oz technique . the participants were asked to fill out questionnaires and annotate the data . |
A Few-Shot Semantic Parser for Wizard-of-Oz Dialogues with the Precise ThingTalk Representation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to build effective semantic parsers for Wizard-of-Oz are insufficient. |
| Approach: | They propose a new dialogue representation and a sample-efficient methodology that can predict precise dialogue states in WOZ conversations. |
| Outcome: | The proposed model can predict precise dialogue states in WOZ conversations. |
EmoWOZ: A Large-Scale Corpus and Labelling Scheme for Emotion Recognition in Task-Oriented Dialogue Systems (2022.lrec-1)
Copied to clipboard
Shutong Feng, Nurul Lubis, Christian Geishauser, Hsien-chin Lin, Michael Heck, Carel van Niekerk, Milica Gasic
| Challenge: | Existing emotion-annotated task-oriented corpora are limited in size, label richness, and public availability, creating a bottleneck for downstream tasks. |
| Approach: | They propose a large-scale manually emotion-annotated corpus of task-oriented dialogues based on a multi-domain task-orientated dataset. |
| Outcome: | The proposed method is based on a task-oriented dialogue dataset with 11K dialogues and 83K emotion annotations of user utterances. |
EmoInHindi: A Multi-label Emotion and Intensity Annotated Dataset in Hindi for Emotion Recognition in Dialogues (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing datasets for emotion recognition in dialogues are in English . existing datasets are limited to a few languages like Hindi . |
| Approach: | They propose a large conversational dataset in Hindi for multi-label emotion and intensity recognition in conversations . they use a Wizard-of-Oz manner to annotate dialogues with 16 emotion labels . |
| Outcome: | The proposed dataset contains 1,814 dialogues with 44,247 utterances in Hindi . it is based on a Wizard-of-Oz manner and can detect emotions in conversation . |
Rapidly Piloting Real-time Linguistic Assistance for Simultaneous Interpreters with Untrained Bilingual Surrogates (2024.lrec-main)
Copied to clipboard
Alvin C. Grissom II, Jo Shoemaker, Benjamin Goldman, Ruikang Shi, Craig Stewart, C. Anton Rytting, Leah Findlater, Jordan Boyd-Graber
| Challenge: | Simultaneous interpretation is a cognitively taxing task, and even seasoned professionals benefit from real-time assistance. |
| Approach: | They propose a simultaneous interpretation task that mimics the cognitive load of interpretation with crowdworker surrogates. |
| Outcome: | The proposed task mimics the cognitive load of interpretation with crowdworker surrogates . the evaluation setup provides consistent results between expert and proxy participants . |