Ibrahim Khalil Khebour, Kenneth Lai, Mariah Bradford, Yifan Zhu, Richard A. Brutti, Christopher Tam, Jingxuan Tu, Benjamin A. Ibarra, Nathaniel Blanchard, Nikhil Krishnaswamy, James Pustejovsky
| Challenge: | In dialogue modeling, there is considerable attention on “dialogue state tracking” (DST) but “common ground tracking” identifies the shared belief space held by all participants in a task-oriented dialogue: the task-relevant propositions all participants accept as true. |
| Approach: | They propose a method for automatically identifying the current set of shared beliefs and ”questions under discussion” of a group with a shared goal. |
| Outcome: | The proposed method predicts moves toward building common ground relative to ground truth in a multimodal interaction with an AI. |
Similar Papers
Finding Common Ground: Annotating and Predicting Common Ground in Spoken Conversations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Creating and updating common ground (CG) between interlocutors is the key to a successful conversation. |
| Approach: | They propose a new annotation and corpus to capture common ground in human communication . they then conduct experiments to extract propositions from dialog and track their status in common ground from the perspective of each speaker . |
| Outcome: | The proposed corpus captures common ground from the perspective of two speakers in a dialog. |
Achieving Common Ground in Multi-modal Dialogue (2020.acl-tutorials)
Copied to clipboard
| Challenge: | tutorial focuses on three main topic areas: grounding in human-human communication, dialogue systems and multi-modal interactive systems. |
| Approach: | This tutorial examines the use of computational dialogue research to design grounding modules and behaviors in cutting-edge systems. |
| Outcome: | This tutorial examines the results of recent research on grounding in human-human communication . it shows how these results lead to rich and challenging opportunities for doing grounding more flexible and powerful ways . |
Maintaining Common Ground in Dynamic Environments (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing task settings focus on creating and maintaining common ground under static contexts and ignore their dynamic aspects. |
| Approach: | They propose a task setting to study the ability of creating and maintaining common ground in dynamic environments. |
| Outcome: | The proposed task setting enables fine-grained evaluation and analysis of various dialogue systems. |
Beyond the Granularity: Multi-Perspective Dialogue Collaborative Selection for Dialogue State Tracking (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that task-oriented dialogue systems have attracted growing attention and achieved substantial progress. |
| Approach: | They propose a method that dynamically selects relevant dialogue contents for each slot . they retrieve turn-level utterances and evaluate their relevance to the slot from three perspectives . |
| Outcome: | The proposed method achieves state-of-the-art performance on MultiWOZ 2.1 and MultiWOz 2.2 and superior performance on multiple mainstream benchmark datasets. |
Conversational Semantic Parsing for Dialog State Tracking (2020.emnlp-main)
Copied to clipboard
Jianpeng Cheng, Devang Agrawal, Héctor Martínez Alonso, Shruti Bhargava, Joris Driesen, Federico Flego, Dain Kaplan, Dimitri Kartsaklis, Lin Li, Dhivya Piraviperumal, Jason D. Williams, Hong Yu, Diarmuid Ó Séaghdha, Anders Johannsen
| Challenge: | Language understanding for task-based dialog systems is often termed "dialog state tracking" (DST) whereas semantic parsing is the task of converting a single-turn utterance to a graphstructured meaning representation, DST is more complex. |
| Approach: | They propose a framework for dialog state tracking that incorporates semantic compositionality, cross-domain knowledge sharing and co-reference. |
| Outcome: | The proposed framework improves on state-of-the-art approaches for dialog state tracking (DST) it incorporates semantic compositionality, cross-domain knowledge sharing and co-reference. |
Dialogue Collection for Recording the Process of Building Common Ground in a Collaborative Task (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing studies on the process of building common ground have not been well conducted. |
| Approach: | They propose a method for recording the process of building common ground through a dialogue by using the intermediate result of a task. |
| Outcome: | The proposed method can record the building common ground process by using the intermediate result of a task and can be estimated quite accurately. |
Beyond Single-User Dialogue: Assessing Multi-User Dialogue State Tracking Capabilities of Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. |
| Approach: | They extend existing DST dataset by generating utterances of a second user based on speech act theory. |
| Outcome: | The proposed model incorporates utterances of a second user into conversations, enabling a controlled evaluation of LLMs in multi-user settings. |
Fully Statistical Neural Belief Tracking (P18-2)
Copied to clipboard
| Challenge: | Existing framework for a dialogue state tracking model requires an expensive manual retuning step . |
| Approach: | They propose to improve existing NBT model by removing a manual retuning step . they propose two different statistical update mechanisms to improve model performance . |
| Outcome: | The proposed model achieves competitive performance and provides a robust framework for building resource-light DST models. |
S3-DST: Structured Open-Domain Dialogue Segmentation and State Tracking in the Era of LLMs (2024.findings-acl)
Copied to clipboard
Sarkar Snigdha Sarathi Das, Chirag Shah, Mengting Wan, Jennifer Neville, Longqi Yang, Reid Andersen, Georg Buscher, Tara Safavi
| Challenge: | Dialogue state tracking (DST) was based on narrow task-oriented conversations . however, large language models have ushered in more flexible open-domain chat systems . |
| Approach: | They propose a method that combines dialogue segmentation and state tracking within open-domain dialogues to improve long context tracking. |
| Outcome: | The proposed method outperforms the state-of-the-art on open-domain dialogue datasets and publicly available datasets. |
Multi-Domain Dialogue State Tracking By Neural-Retrieval Augmentation (2022.findings-aacl)
Copied to clipboard
| Challenge: | Existing approaches for DST are conditioned on previous dialogue states, but the dependency on previous dialogs makes it difficult to prevent error propagation to subsequent turns. |
| Approach: | They propose to create a Neural Index based on dialogue context by analyzing user dialogue and previous turn state and generating a retrieval-guided generation approach. |
| Outcome: | The proposed framework retrieves dialogue context from the index built using unstructured dialogue state and structured user/system utterances. |