Follow-on Question Suggestion via Voice Hints for Voice Assistants (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Query suggestion is a standard feature of screen-based search experiences, but it is not trivial to implement in voice-based settings. |
| Approach: | They propose a task of suggesting questions with compact voice hints to allow users to ask follow-up questions. |
| Outcome: | The proposed approach is based on a dataset of 6681 input questions and human written hints and is highly linguistically motivated. |
Similar Papers
Referring to Screen Texts with Voice Assistants (2023.acl-industry)
Copied to clipboard
Shruti Bhargava, Anand Dhoot, Ing-marie Jonsson, Hoang Long Nguyen, Alkesh Patel, Hong Yu, Vincent Renkens
| Challenge: | a new approach to voice assistants is limited in their ability to understand context of the user. |
| Approach: | They propose a general purpose model that allows users to refer to phone numbers, addresses, email addresses, urls, and dates on their phone screens. |
| Outcome: | The proposed model is lightweight, offering flexibility, better interpretability and efficient run time memory. |
Answering Unanswered Questions through Semantic Reformulations in Spoken QA (2023.acl-industry)
Copied to clipboard
| Challenge: | Question Answering (QA) is a longstanding NLP task, and voice assistants like Alexa have made Spoken QA ubiquitous. |
| Approach: | They propose a model that uses linguistically-grounded operations to rewrite questions to facilitate answering. |
| Outcome: | The proposed model improves answer rates on 1M unanswered questions from a leading voice assistant. |
VoiSeR: A New Benchmark for Voice-Based Search Refinement (2021.eacl-main)
Copied to clipboard
| Challenge: | a new study shows that voice-based search systems are challenging to support in the context of the user intent of voice searches . support for voice-driven search, exploration, and refinement is a fundamental aspect of voice assistants . |
| Approach: | They propose to use crowdsourcing to collect voice-based search refinements . they use 10,000 search refinement utterances to annotate a search intent . |
| Outcome: | The proposed dataset shows that voice-based search refinements can support most common tasks . the study shows that the proposed dataset can support research in conversational query understanding . |
“Alexa in the wild” – Collecting Unconstrained Conversations with a Modern Voice Assistant in a Public Environment (2020.lrec-1)
Copied to clipboard
| Challenge: | Currently, many studies on human-machine interactions focus on private usage, short pre-defined tasks or specific domains. |
| Approach: | They propose to collect 40 hours of device directed utterances during a science exhibition in germany and extract transcripts of both visitors requests and Alexa answers. |
| Outcome: | The proposed dataset provides an unconstrained, unscripted public interaction with a voice assistant during a science exhibition in germany. |
Reducing Sensitivity on Speaker Names for Text Generation from Dialogues (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models are sensitive to nuances, resulting in unfairness in real-world applications. |
| Approach: | They propose to quantitatively measure a model's sensitivity on speaker names and comprehensively evaluate a number of known methods for reducing speaker name sensitivity. |
| Outcome: | The proposed approach reduces speaker name sensitivity and improves quality of generation. |
Chat or Learn: a Data-Driven Robust Question-Answering System (2020.lrec-1)
Copied to clipboard
| Challenge: | QA systems tend to perform poorly at chitchat, while data-driven chatbots are typically user-friendly but not goal-oriented . |
| Approach: | They propose to use a controller to perform dialogue act classification and feed user input either to a sequence-to-sequence chatbot or to QA systems. |
| Outcome: | The proposed system is a spoken QA application for the Google Home smart speaker. |
Does Your Voice Assistant Remember? Analyzing Conversational Context Recall and Utilization in Voice Interaction Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in multi-turn voice interaction models have improved user-model communication, but whether open-source models share this ability remains unexplored. |
| Approach: | They propose to use ContextDialog to evaluate open-source interaction models' ability to recall past utterances to identify key limitations. |
| Outcome: | The proposed model retains and recalls past utterances better than closed-source models, but still struggles with questions about past . findings highlight key limitations in open-source model and suggest ways to improve memory retention and retrieval robustness. |
Speech Translation and the End-to-End Promise: Taking Stock of Where We Are (2020.acl-main)
Copied to clipboard
| Challenge: | Until recently, the only feasible approach to translating acoustic speech signals into text was the cascaded approach. |
| Approach: | They propose a classification of the main challenges of traditional approaches to speech translation . they argue that end-to-end models fall short due to compromises made to address data scarcity . |
| Outcome: | This paper provides a brief survey of the main challenges of traditional approaches in speech translation . it reveals that many end-to-end models fail due to compromises made to address data scarcity. |
Bootstrapping a Music Voice Assistant with Weak Supervision (2021.naacl-industry)
Copied to clipboard
| Challenge: | Music listening is among the top-5 reasons of daily usage of voice assistants in the US. |
| Approach: | They propose a weakly-supervised method to label large amounts of voice query logs . they show that slot tagging models outperform models trained on hand-annotated or synthetic data . |
| Outcome: | The proposed method outperforms models trained on hand-annotated or synthetic data at a lower cost. |
Dealing with Data Scarcity in Spoken Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | erroneous automatic speech recognition transcriptions and data scarcity hinder spoken QA models . paper focuses on using limited annotated data to improve spoken qa performance . |
| Approach: | They propose a framework for utilizing limited annotated data effectively to improve spoken QA performance. |
| Outcome: | The proposed model produces question-answer pairs from unannotated data with 5.5% relative gain over the model trained with annotated datasets. |