| Challenge: | a dialog system that can monitor the health status of seniors has a huge potential for solving the labor shortage in the caregiving industry in aging societies. |
| Approach: | They are developing a yes/no response classifier and an entailment recognizer to correctly interpret user utterances. |
| Outcome: | The proposed system can correctly interpret user utterances and can monitor the health of seniors. |
Similar Papers
What is wrong with you?: Leveraging User Sentiment for Automatic Dialog Evaluation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing metrics for dialog evaluation are trained on human annotations, which is cumbersome to collect. |
| Approach: | They propose to use user sentiment and other information as proxy to measure the quality of previous dialogs. |
| Outcome: | The proposed model is comparable to models trained on human annotated data. |
Robots-Dont-Cry: Understanding Falsely Anthropomorphic Utterances in Dialog Systems (2022.emnlp-main)
Copied to clipboard
| Challenge: | Dialog systems often output human-like responses, but some are impossible for a machine to say. |
| Approach: | They collect ratings on the feasibility of 900 two-turn dialogs from 9 data sources . they build classifiers and explore how modeling configuration might affect output permissibly . |
| Outcome: | The proposed model can be used to train human-like dialogs, but it is not anthropomorphic. |
USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Standard language generation metrics have been shown to be ineffective for dialog evaluation. |
| Approach: | They propose an unsupervised evaluation metric for dialog that trains unsupervised models to measure several desirable qualities of dialog. |
| Outcome: | The proposed evaluation metric strongly correlates with human judgment on Topical-Chat and PersonaChat. |
DialogSum: A Real-Life Scenario Dialogue Summarization Dataset (2021.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show unique challenges in dialogue summarization such as spoken terms, special discourse structures, coreferences and ellipsis, pragmatics and social common sense. |
| Approach: | They propose a large-scale labeled dialogue summarization dataset . they use state-of-the-art neural models to analyze spoken dialogue summaries . |
| Outcome: | The proposed dataset can be used to analyze spoken dialogue summarization challenges. |
DiaLLMs: EHR-Enhanced Clinical Conversational System for Clinical Test Recommendation and Diagnosis Prediction (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing medical LLMs focus primarily on diagnosis recommendation, limiting their clinical applicability. |
| Approach: | They propose a medical LLM that integrates heterogeneous EHR data into clinically grounded dialogues. |
| Outcome: | The proposed model outperforms baselines in clinical test recommendation and diagnosis prediction. |
Gaining Insights into Unrecognized User Utterances in Task-Oriented Dialog Systems (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Goal-oriented dialog systems fail to recognize the intent of natural language requests due to system errors, incomplete service coverage, or insufficient training. |
| Approach: | They propose an end-to-end pipeline for processing unrecognized user utterances, deployed in a commercial task-oriented dialog system, including a specifically-tailored clustering algorithm, a novel approach to cluster representative extraction, and cluster naming. |
| Outcome: | The proposed components show that they improve the performance of the proposed system in the analysis of unrecognized user requests. |
Designing Precise and Robust Dialogue Response Evaluators (2020.acl-main)
Copied to clipboard
| Challenge: | Existing automated dialogue response evaluators have only moderate correlation with human judgement and are not robust. |
| Approach: | They propose to build a reference-free dialogue response evaluator that exploits the power of semi-supervised training and pretrained (masked) language models. |
| Outcome: | The proposed model achieves strong correlation with human judgement and generalizes robustly to diverse responses and corpora. |
Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries (2021.acl-short)
Copied to clipboard
| Challenge: | despite advances in task-oriented and chit-chat based dialogue systems, many systems rely on static and unnatural responses. |
| Approach: | They propose a neural approach which generates contextually aware responses to user queries . they perform automatic and manual evaluations to demonstrate the efficacy of the system . |
| Outcome: | The proposed approach generates responses which are contextually aware with the user query and say no to the user. |
DialogVCS: Robust Natural Language Understanding in Dialogue System Upgrade (2024.naacl-long)
Copied to clipboard
Zefan Cai, Xin Zheng, Tianyu Liu, Haoran Meng, Jiaqi Han, Gang Yuan, Binghuai Lin, Baobao Chang, Yunbo Cao
| Challenge: | Existing models for natural language understanding are based on a well-defined intent 1 ontology. |
| Approach: | They propose to retrain the natural language understanding model as new data from real users are merged into existing data. |
| Outcome: | The proposed model shows that the semantically entangled intents can be recognized with an automatic workflow. |
Intent Features for Rich Natural Language Understanding (2021.naacl-industry)
Copied to clipboard
| Challenge: | generic dialog systems, or chatbots, are increasingly popular, but most industrial dialog systems are built for specific clients and use cases. |
| Approach: | They propose a new neural network architecture that allows for domain and topic agnostic properties of intents that can be learnt from syntactic cues only. |
| Outcome: | The proposed model improves on baselines for identifying intent features in a deployed, multi-intent natural language understanding module. |