Challenge: Existing datasets for Task-Oriented Dialogs (TOD) lack consideration for adaptive response styles and neglect to simulate interactions with app contexts like calendars or alarms.
Approach: They propose to generate an annotated task-oriented dialog dataset and an automatic pipeline to generate it.
Outcome: The proposed dataset provides a variety of system response styles and provides verbose or non-verbal responses.

Similar Papers

PicPersona-TOD : A Dataset for Personalizing Utterance Style in Task-Oriented Dialogue with Image Persona (2025.naacl-long)

Copied to clipboard

Challenge: Existing systems produce generic, monotonic responses that lack individuality and fail to adapt to users’ personal attributes.
Approach: They propose a dataset that incorporates user images as part of the persona, enabling personalized responses tailored to user-specific factors such as age or emotional context.
Outcome: The proposed dataset enhances user experience, with personalized responses contributing to a more engaging interaction.
AutoEval-ToD: Automated Evaluation of Task-oriented Dialog Systems (2025.naacl-long)

Copied to clipboard

Challenge: Current evaluation methodologies heavily depend on human annotators, which can be inefficient, subjective, and expensive to scale.
Approach: They propose an automated end-to-end evaluation framework that interacts with the ToD system and then assesses its performance across key dimensions.
Outcome: The proposed framework first interacts with the ToD system and assesses its performance across key dimensions by analyzing both its responses and internal states.
DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialogues (2024.lrec-main)

Copied to clipboard

Challenge: User Simulators are used to train task-oriented dialogue systems . traditional training paradigms rely on human-engineered agendas resulting in generated responses that lack diversity and spontaneity.
Approach: They propose a framework that leverages large language models to generate diverse responses . they use two LLMs to generate and verify responses, which are preferred by users .
Outcome: The proposed framework produces responses that exhibit diversity and are preferred by human users.
TOD-Flow: Modeling the Structure of Task-Oriented Dialogues (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in task-oriented dialogue systems have limitations regarding transparency and controllability.
Approach: They propose to infer the TOD-flow graph from dialog data annotated with dialog acts and integrate it with any dialogue model to improve its prediction performance, transparency, and controllability.
Outcome: The proposed approach improves dialog act classification and response generation performance in the MultiWOZ and SGD benchmarks.
SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversations (2021.emnlp-main)

Copied to clipboard

Challenge: Existing task-oriented dialog datasets do not situate the dialog in the user’s multimodal context.
Approach: They propose to use a dataset to study multimodal task-oriented dialogs in the shopping domain to situate them in the user’s multimodal context.
Outcome: The proposed dataset includes 11K task-oriented user->assistant dialogs (117K utterances) in the shopping domain, grounded in immersive and photo-realistic scenes.
SQLWOZ: A Realistic Task-Oriented Dialogue Dataset with SQL-Based Dialogue State Representation for Complex User Requirements (2025.emnlp-main)

Copied to clipboard

Challenge: Existing TOD datasets present simplified interactions with simple slot-value style constraints and preferences.
Approach: They propose a novel TOD dataset that captures complex user requirements using SQL statements.
Outcome: The proposed dataset captures complex, real-world user requirements.
Multi 3 WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems (2023.tacl-1)

Copied to clipboard

Challenge: Task-oriented dialog (TOD) is one of the central objectives, hallmarks, and applications of machine intelligence.
Approach: They propose a multilingual, multi-domain, multiparallele ToD dataset that offers culturally adapted dialogs in 4 languages for training and evaluation of multilingual and cross-lingual systems.
Outcome: The proposed dataset is large-scale and culturally adapted to enable training and evaluation of multilingual and cross-lingual ToD systems.
SynTOD: Augmented Response Synthesis for Robust End-to-End Task-Oriented Dialogue System (2024.lrec-main)

Copied to clipboard

Challenge: Task-oriented dialogue systems focus on training multiple tasks such as language understanding, tracking states, and generating appropriate responses to help users achieve their specific goals.
Approach: They exploit the ability of pre-trained models to provide synthesis responses for fine-tuning end-to-end TOD systems.
Outcome: The proposed model outperforms baseline models on multiwoz datasets and is available for further exploitation.
I know you are different! Towards Persona Driven Knowledge-infused Dialogue Assistant (2026.eacl-long)

Copied to clipboard

Challenge: Task-Oriented Dialogue (TOD) systems often fall short in delivering personalized, context-rich responses, especially in low-resource, code-mixed, and multimodal settings like Hinglish.
Approach: They propose a Hinglish multimodal, multidomain, persona-based TOD dataset that captures user-agent interactions across text and visual modalities.
Outcome: The proposed framework outperforms standard and ablated models in Hinglish and Hinglanish.
JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset (2024.lrec-main)

Copied to clipboard

Challenge: Existing datasets for task-oriented dialogue systems in English are limited compared to Japanese.
Approach: They evaluated the dialogue state tracking and response generation capabilities of Japanese language datasets using multi-domain task-oriented dialogues.
Outcome: The proposed dataset provides a benchmark that is on par with MultiWOZ2.2 and the latest large language model (LLM)-based methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations