Memory Consolidation for Contextual Spoken Language Understanding with Dialogue Logistic Inference (P19-1)
Copied to clipboard
| Challenge: | Existing models for SLU use explicit memory representations, but the context memory is under-exploited. |
| Approach: | They propose a dialogue logistic inference task to consolidate the context memory with SLU in a multi-task framework. |
| Outcome: | The proposed model improves slot filling and domain classification performance in a multi-task framework. |
Similar Papers
Scaling Multi-Domain Dialogue State Tracking via Query Reformulation (N19-2)
Copied to clipboard
| Challenge: | Using a pointer-generator network, we model the reference resolution task as a dialogue context-aware user query reformulation task. |
| Approach: | They propose a pointer-generator network and a novel multi-task learning setup to model dialogue state tracking and referring expression resolution tasks using a dialogue context-aware user query reformulation task. |
| Outcome: | The proposed model improves absolute F1 on internal and public benchmarks. |
MoE-SLU: Towards ASR-Robust Spoken Language Understanding via Mixture-of-Experts (2024.findings-acl)
Copied to clipboard
| Challenge: | Spoken language understanding (SLU) is a crucial task in task-oriented dialogue systems. |
| Approach: | They propose an ASR-Robust SLU framework based on the mixture-of-experts technique to generate additional transcripts from clean transcripts and use it to weigh the representations of the generated transcripts, ASR transcripts . |
| Outcome: | The proposed framework achieves state-of-the-art on three benchmark SLU datasets. |
How Time Matters: Learning Time-Decay Attention for Contextual Spoken Language Understanding in Dialogues (N18-1)
Copied to clipboard
| Challenge: | Spoken language understanding (SLU) is an essential component in conversational systems. |
| Approach: | They propose a universal time-decay attention mechanism that can be used to decay utterances on the sentence-level and speaker-level. |
| Outcome: | The proposed model significantly improves the state-of-the-art model for contextual understanding performance on the benchmark Dialogue State Tracking Challenge (DSTC4) dataset. |
SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Tasks (2023.acl-long)
Copied to clipboard
Suwon Shon, Siddhant Arora, Chyi-Jiunn Lin, Ankita Pasad, Felix Wu, Roshan S Sharma, Wei-Lun Wu, Hung-yi Lee, Karen Livescu, Shinji Watanabe
| Challenge: | Spoken language understanding (SLU) tasks have received little attention and resources compared to lower-level tasks like speech and speaker recognition. |
| Approach: | They propose annotated SLU benchmark tasks based on freely available speech data to complement existing benchmarks and address gaps in the evaluation landscape. |
| Outcome: | The proposed benchmarks complement existing benchmarks and address gaps in the evaluation landscape. |
OpenSLU: A Unified, Modularized, and Extensible Toolkit for Spoken Language Understanding (2023.acl-demo)
Copied to clipboard
| Challenge: | Spoken Language Understanding (SLU) is a task-oriented dialogue system . open-source toolkit provides a unified, modularized, and extensible toolkit for SLU . |
| Approach: | They introduce an open-source toolkit to provide a unified toolkit for spoken language understanding. |
| Outcome: | The proposed toolkit unifies 10 models for both single-intent and multi-intention scenarios. |
PRoDeliberation: Parallel Robust Deliberation for End-to-End Spoken Language Understanding (2024.findings-emnlp)
Copied to clipboard
Trang Le, Daniel Lazar, Suyoun Kim, Shan Jiang, Duc Le, Adithya Sagar, Aleksandr Livshits, Ahmed Aly, Akshat Shrivastava
| Challenge: | End-to-end models for Spoken Language Understanding have been autoregressive, resulting in higher latencies. |
| Approach: | They propose a method that uses Connectionist Temporal Classification to train robust non-autoregressive deliberation models. |
| Outcome: | The proposed method achieves 10x latency reduction over autoregressive models while preserving ability to correct ASR mistranscriptions. |
End-to-End Neural Discourse Deixis Resolution in Dialogue (2022.emnlp-main)
Copied to clipboard
| Challenge: | Lexical overlap is a strong indicator of entity coreference, both among names and in the resolution of nominals. |
| Approach: | They propose to extend their span-based entity coreference model to exploit task-specific characteristics of discourse deixis resolution in dialogue. |
| Outcome: | The proposed model achieves state-of-the-art results on the four datasets in the CODI-CRAC 2021 shared task. |
UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions (2024.naacl-long)
Copied to clipboard
Siddhant Arora, Hayato Futami, Jee-weon Jung, Yifan Peng, Roshan Sharma, Yosuke Kashiwagi, Emiru Tsunoo, Karen Livescu, Shinji Watanabe
| Challenge: | Recent studies leverage large language models with multi-tasking capabilities, using natural language prompts to guide the model’s behavior and surpassing performance of task-specific models. |
| Approach: | They adapt a pre-trained automatic speech recognition model to additional tasks using single-token task specifiers. |
| Outcome: | The proposed model can generalize to new datasets and languages for seen task types. |
Multi-task Learning of Spoken Language Understanding by Integrating N-Best Hypotheses with Hierarchical Attention (2020.coling-industry)
Copied to clipboard
| Challenge: | Existing methods to integrate hypotheses into speech recognition systems are noisy and can cause information loss. |
| Approach: | They propose to integrate hypotheses into multi-task learning and transfer learning to improve performance. |
| Outcome: | The proposed model improves domain and intent classification by 19% and 37% compared to current methods . the proposed model could recover transcription and rewrite the query for a better understanding . |
CASA-NLU: Context-Aware Self-Attentive Natural Language Understanding for Task-Oriented Chatbots (D19-1)
Copied to clipboard
| Challenge: | Prior work on contextual NLU has been limited in terms of the types of contextual signals used and the understanding of their impact on the model. |
| Approach: | They propose a context-aware self-attentive NLU model that uses multiple signals over a variable context window, such as previous intents, slots, dialog acts and utterances, in addition to the current user uttered. |
| Outcome: | The proposed model outperforms a baseline model on two conversational datasets yielding a gain of up to 7% on the IC task. |