Development and Deployment of a Large-Scale Dialog-based Intelligent Tutoring System (N19-2)
Copied to clipboard
Shazia Afzal, Tejas Dhamecha, Nirmal Mukhi, Renuka Sindhgatta, Smit Marvaniya, Matthew Ventura, Jessica Yarbro
| Challenge: | Dialog-based intelligent tutoring systems capture the effectiveness of expert human teacher-learner interactions by using natural language dialogue. |
| Approach: | They propose to use dialog-based tutoring systems to help students learn through a sequence of dialogue moves in natural language to steer them through varying levels of content granularity. |
| Outcome: | The proposed system is being used by hundreds of college level students for practice and self-regulated study in diverse subjects like Sociology, Communications, and American Government. |
Similar Papers
Deep Learning for Dialogue Systems (C18-3)
Copied to clipboard
| Challenge: | Using deep learning to build robust and scalable spoken dialogue systems is still a challenging task. |
| Approach: | tutorial focuses on an overview of dialogue system development . goal-oriented spoken dialogue systems are most prominent component in virtual personal assistants . |
| Outcome: | This tutorial focuses on an overview of dialogue system development while summarizing the challenges. |
Opportunities and Challenges in Neural Dialog Tutoring (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to designing dialog tutors have been challenging . current approaches perform poorly in constrained learning scenarios, authors find . |
| Approach: | They analyze dialog tutoring models using automatic and human evaluations to understand the new opportunities brought by dialog tutors. |
| Outcome: | The proposed models perform poorly in less constrained learning scenarios, the authors show . they find large number of model reasoning errors in 45% of conversations . |
High Performance Natural Language Processing (2020.emnlp-tutorials)
Copied to clipboard
| Challenge: | a tutorial on scaling natural language processing will recapitulate the state-of-the-art in the field . |
| Approach: | This cutting-edge tutorial recapitulates the state-of-the-art in natural language processing with scale in perspective. |
| Outcome: | This cutting-edge tutorial recapitulates the state-of-the-art in natural language processing with scale in perspective. |
Are the Tools up to the Task? an Evaluation of Commercial Dialog Tools in Developing Conversational Enterprise-grade Dialog Systems (N19-2)
Copied to clipboard
| Challenge: | Existing toolsets are incomplete in meeting the goal of building effective dialog systems, authors say . |
| Approach: | They compare dialog tools available from a number of companies to determine their strengths and weaknesses . they provide quantitative and qualitative results in three main areas: natural language understanding, dialog, and text generation . |
| Outcome: | The toolsets are incomplete, but they are compared to other tools to determine their strengths and weaknesses. |
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets (2023.findings-acl)
Copied to clipboard
Md Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, Md Amran Hossen Bhuiyan, Shafiq Joty, Jimmy Huang
| Challenge: | Currently, the evaluation of large language models (LLMs) such as ChatGPT in academic datasets is difficult due to the difficulty of evaluating the generative outputs produced by this model against the ground truth. |
| Approach: | They evaluate ChatGPT across 140 tasks and analyze 255K responses it generates in academic datasets. |
| Outcome: | The proposed model performs well on 140 tasks and generates 255K responses in these datasets. |
Large-Scale Transfer Learning for Natural Language Generation (P19-1)
Copied to clipboard
Sergey Golovanov, Rauf Kurbanov, Sergey Nikolenko, Kyryl Truskovskyi, Alexander Tselousov, Thomas Wolf
| Challenge: | Large-scale pretrained language models define state of the art in natural language processing, achieving outstanding performance on a variety of tasks. |
| Approach: | They propose to apply large-scale pretrained language models to natural language generation tasks by comparing architectural and training schemes. |
| Outcome: | The proposed architectures perform well on open-domain dialog as a typical high entropy generation task. |
Deep Learning for Conversational AI (N18-6)
Copied to clipboard
| Challenge: | Spoken Dialogue Systems (SDS) have great commercial potential . the advent of deep learning has led to significant advances in this area of NLP research . |
| Approach: | This tutorial will introduce researchers to the pipeline framework for modelling goal-oriented dialogue systems. |
| Outcome: | This tutorial will familiarise researchers with the latest advances in spoken dialogue systems . the aim of the course is to encourage dialogue research in the NLP community . |
KwaiChat: A Large-Scale Video-Driven Multilingual Mixed-Type Dialogue Corpus (2025.findings-naacl)
Copied to clipboard
Xiaoming Shi, Zeming Liu, Yiming Lei, Chenkai Zhang, Haitao Leng, Chuan Wang, Qingjie Liu, Wanxiang Che, Yunhong Wang
| Challenge: | Currently, video-based dialogue systems rely on a single dialogue type, hindering their versatility in practical applications. |
| Approach: | They propose to generate video-driven multilingual mixed-type dialogues using KwaiChat . they propose to create a video-based multilingual mix of 4 dialogue types, 30 domains, 4 languages, 13 topics . |
| Outcome: | The proposed model performs best on KwaiChat but is not perfect in this situation. |
Scalable Construction and Reasoning of Massive Knowledge Bases (N18-6)
Copied to clipboard
| Challenge: | Existing knowledge mining systems assume abundant human annotations for training high quality machine learning models, which is impractical when trying to deploy IE systems to a broad range of domains, settings and languages. |
| Approach: | They introduce how to extract structured facts from text corpora to construct knowledge bases. |
| Outcome: | The proposed methods are weakly-supervised and domain-independent for knowledge base construction across various domains. |
Medical Dialogue System: A Survey of Categories, Methods, Evaluation and Challenges (2024.findings-acl)
Copied to clipboard
Xiaoming Shi, Zeming Liu, Li Du, Yuxuan Wang, Hongru Wang, Yuhang Guo, Tong Ruan, Jie Xu, Xiaofan Zhang, Shaoting Zhang
| Challenge: | Existing medical dialogue systems have significant potential to simplify diagnostic procedure and reduce the cost of collecting information from patients. |
| Approach: | They analyze 325 papers from well-known computer science, natural language processing conferences and journals to find out the major challenges of medical dialog systems. |
| Outcome: | The proposed systems have been surveyed in the medical community but have not been evaluated from a technical perspective. |