Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network (P18-1)
Copied to clipboard
| Challenge: | Existing models for matching dialogue responses rely on semantic and functional dependencies . a recent study only uses the last utterance in context for matching a reply . |
| Approach: | They propose a model that matches a response with its multi-turn context using attention. |
| Outcome: | The proposed model outperforms the state-of-the-art models on two large-scale multi-turn response selection tasks. |
Similar Papers
Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots (D19-1)
Copied to clipboard
| Challenge: | Existing studies focus on matching candidate responses with every context utterance, but it also brings noise signals and unnecessary information. |
| Approach: | They propose a multi-hop selector network to match context with candidate responses . they propose to use a selector to filter the relevant utterances as context . |
| Outcome: | The proposed model outperforms state-of-the-art methods on three public multi-turn dialogue datasets. |
Multi-turn Response Selection using Dialogue Dependency Relations (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for multi-turn response selection ignore the dependencies between the turns. |
| Approach: | They propose a dialogue extraction algorithm to transform a dialog history into threads based on their dependency relations. |
| Outcome: | The proposed model outperforms the state-of-the-art models on DSTC7 and DSTF8* with competitive results on UbuntuV2 . |
Modeling Multi-turn Conversation with Deep Utterance Aggregation (C18-1)
Copied to clipboard
| Challenge: | Existing work on retrieval-based context modeling for multi-turn conversation ignores interactions among previous utterances. |
| Approach: | They propose retrieval-based response matching for multi-turn conversation . they propose to combine previous utterances into context using a deep utterrance aggregation model . |
| Outcome: | The proposed model outperforms state-of-the-art methods on three multi-turn conversation benchmarks including an e-commerce dialogue corpus. |
Reading Turn by Turn: Hierarchical Attention Architecture for Spoken Dialogue Comprehension (P19-1)
Copied to clipboard
| Challenge: | Existing research on multi-turn spoken conversations focuses on reading comprehension of passages . interactivity of spoken content can cause lower information density and topic diffusion . |
| Approach: | They propose a hierarchical attention neural network architecture to improve spoken dialogue comprehension by combining turn-level and word-level attention mechanisms. |
| Outcome: | The proposed approach outperforms baseline attention models and is robust to lengthy and out-of-distribution test samples. |
ReCoSa: Detecting the Relevant Contexts with Self-Attention for Multi-turn Dialogue Generation (P19-1)
Copied to clipboard
| Challenge: | Existing hierarchical recurrent encoder-decoder models treat all contexts indiscriminately, which may hurt the following response generation process. |
| Approach: | They propose a hierarchical recurrent encoder-decoder model that treats all contexts indiscriminately and uses a word level LSTM encoder to obtain the initial representation of each context. |
| Outcome: | The proposed model outperforms baseline models on Chinese customer services and English Ubuntu dialogue datasets in terms of both metric-based and human evaluations. |
Constructing Interpretive Spatio-Temporal Features for Multi-Turn Responses Selection (P19-1)
Copied to clipboard
| Challenge: | Existing models for response selection do not perform well when there are many candidate responses. |
| Approach: | They propose a Spatio-Temporal Matching network (STM) for response selection . they use soft alignment to obtain local relevance between context and response . |
| Outcome: | The proposed model significantly outperforms the state-of-the-art model on two large-scale multi-turn response selection tasks. |
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce (P18-2)
Copied to clipboard
| Challenge: | Recent researches focus on deep learning and reinforcement learning for multi-turn information seeking conversation systems. |
| Approach: | They propose an efficient and effective multi-turn conversation model based on convolutional neural networks and extend it to adapt the knowledge learned from a resource-rich domain to enhance the performance. |
| Outcome: | The proposed model performs better than the existing model on an industrial chatbot called AliMe Assist. |
Attend, Select and Eliminate: Accelerating Multi-turn Response Selection with Dual-attention-based Content Elimination (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models can be used to perform multi-turn response selection, but they can be expensive. |
| Approach: | They propose a framework and a strategy that progressively selects and eliminates unimportant content under context-response dual-attention. |
| Outcome: | The proposed method can effectively speed-up SOTA models without much performance degradation and shows a better trade-off between speed and performance than previous methods. |
Lingke: a Fine-grained Multi-turn Chatbot for Customer Service (C18-2)
Copied to clipboard
| Challenge: | e-commerce chatbots usually need a mass of human dialogue data to train, but for multi-turn conversations, the performance is poor. |
| Approach: | They propose an information retrieval augmented multi-turn chatbot which can answer questions based on unstructured documents and deal with multi-turned conversations. |
| Outcome: | The proposed solution outperforms all other models in multi-turn conversations and can learn from conversation records. |
How to Represent Context Better? An Empirical Study on Context Modeling for Multi-turn Response Selection (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on building a conversational system for open domain human-machine conversation is attracting more attention . early models concatenate all utterances or independently encode each dialogue turn, which may lead to an inadequate understanding of dialogue status. |
| Approach: | They propose to use a turn-aware context modeling layer to adapt existing models . they propose to model multi-turn contexts from the perspective of sequential relationship, local relationship, and query-alike manner . |
| Outcome: | The proposed method can be adapted to several advanced response selection models. |