KTH Tangrams: A Dataset for Research on Alignment and Conceptual Pacts in Task-Oriented Dialogue (L18-1)
Copied to clipboard
| Challenge: | Existing studies on instructor-manipulator dialogue use disparate but similar datasets . a recent study examined the alignment of referring expressions (RL) in situated dialogue . |
| Approach: | They propose to use a corpus of referring expressions in a relatively free dialogue with physical features generated in simulated situations to study alignment in referring language. |
| Outcome: | The proposed datasets facilitate analysis of dialogic linguistic phenomena regarding alignment in the formation of referring expressions known as conceptual pacts. |
Similar Papers
What Did You Refer to? Evaluating Co-References in Dialogue (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing neural end-to-end dialogue models have limitations on exactly interpreting the linguistic structures in dialogue history context. |
| Approach: | They propose to directly measure the capability of neural end-to-end dialogue models on understanding the entity-oriented structures via question answering. |
| Outcome: | The proposed model can understand large-scale English and Chinese human human dialogues using a large-format dataset. |
doc2dial: A Goal-Oriented Document-Grounded Dialogue Dataset (2020.emnlp-main)
Copied to clipboard
| Challenge: | doc2dial dataset is a goal-oriented document-grounded dialogue model . it is based on how the authors compose documents for guiding end users . |
| Approach: | They propose a dataset of goal-oriented dialogues grounded in documents . they use annotated conversations with an average of 14 turns to generate conversational utterances . |
| Outcome: | The proposed dataset includes over 4500 annotated conversations with an average of 14 turns grounded in over 450 documents from four domains. |
Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing goal-oriented dialogue datasets focus on identifying slots and values, but in reality, customer service agents follow multi-step procedures derived from explicit company policies. |
| Approach: | They propose to use a fully-labeled dataset to study customer service dialogue systems in real-world scenarios. |
| Outcome: | The proposed dataset outperforms existing models but still lacks 50.8% absolute accuracy to reach human-level performance on the dataset. |
A Unifying View On Task-oriented Dialogue Annotation (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent research attention in task-oriented dialogue systems focuses on end-to-end neural models. |
| Approach: | They present a dataset that combines annotated corpora from four domains to provide a unified ontology and annotation schema for task-oriented dialogues. |
| Outcome: | The proposed dataset improves language, information content and performance in dialogues with two recent models. |
Understanding Cross-Lingual Alignment—A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | Cross-lingual alignment is the meaningful similarity of representations across languages in multilingual language models. |
| Approach: | They propose a taxonomy of methods to improve cross-lingual alignment . they argue that an effective trade-off between language-neutral and language-specific information is key . |
| Outcome: | The proposed methods can be applied to encoder models and encoder-decoder-only models . they show that language-neutral and language-specific information is key . |
MuTual: A Dataset for Multi-Turn Dialogue Reasoning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing non-task oriented dialogue systems can yield a relevant and fluent response, but sometimes make logical mistakes because of weak reasoning capabilities. |
| Approach: | They propose a dataset for multi-turn dialogue reasoning that uses annotated dialogues to train a machine to handle various reasoning problems. |
| Outcome: | Empirical results show that state-of-the-art methods only reach 71%, far behind human performance of 94%. |
Social Influence Dialogue Systems: A Survey of Datasets and Models For Social Influence Tasks (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing research focuses on task-oriented or open-domain dialogue systems with influence skills. |
| Approach: | They propose to define and introduce a category of social influence dialogue systems that influence users’ cognitive and emotional responses. |
| Outcome: | The proposed system is task-oriented or goal-oriented, but it is not open-domain. |
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations) (2025.acl-demo)
Copied to clipboard
| Challenge: | ACL 2025 System Demonstration Track accepted 64 papers based on reviews . short-listed 7 papers for Best System Demo award . |
| Approach: | the ACL 2025 System Demonstration Track is a conference for papers describing system demonstrations . the track received a record 187 submissions, of which 178 papers were valid with required materials . |
| Outcome: | the ACL 2025 System Demonstration Track received 187 submissions . 178 papers were valid with required materials . |
The AI Doctor Is In: A Survey of Task-Oriented Dialogue Systems for Healthcare Applications (2022.acl-long)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems have been surveyed in the medical community from a non-technical perspective, but a systematic review from . a rigorous computational perspective has to date remained noticeably absent. |
| Approach: | They analyze 4070 papers on task-oriented dialogue systems for healthcare applications and identify gaps in their analysis. |
| Outcome: | The proposed system-level implementation details remain limited or underspecified, slowing the pace of innovation in this area. |
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop) (2025.acl-srw)
Copied to clipboard
| Challenge: | ACL 2025 Student Research Workshop is a forum for students conducting research in Computational Linguistics, Natural Language Processing, and Machine Learning. |
| Approach: | the ACL 2025 Student Research Workshop will be held in conjunction with ACL 2020 . the virtual conference will be a forum for students conducting research in Computational Linguistics, Natural Language Processing, and Machine Learning. |
| Outcome: | the ACL 2025 Student Research Workshop received 323 valid submissions this year . 104 papers accepted for oral presentation and poster presentations . final acceptance rate stands at 32.2%, consistent with last year's rate . |