Dealing with Data Scarcity in Spoken Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: erroneous automatic speech recognition transcriptions and data scarcity hinder spoken QA models . paper focuses on using limited annotated data to improve spoken qa performance .
Approach: They propose a framework for utilizing limited annotated data effectively to improve spoken QA performance.
Outcome: The proposed model produces question-answer pairs from unannotated data with 5.5% relative gain over the model trained with annotated datasets.

Similar Papers

A Framework for Automatic Generation of Spoken Question-Answering Data (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing frameworks to automatically generate a spoken question answering dataset are limited by the amount of spoken text documents available.
Approach: They propose to use QG module to generate questions from text documents, TTS module to convert text documents into spoken form and automatic speech recognition module to transcribe spoken content.
Outcome: The proposed framework is efficient for automatically generating spoken QA datasets.
A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering (2022.emnlp-demos)

Copied to clipboard

Challenge: Question Answering (QA) is a growing area of research . state-of-the-art QA models struggle on out-of domain documents without fine-tuning .
Approach: They propose a pipeline for validating and training QA data and an interface for human annotation.
Outcome: The proposed pipeline improves QA performance on domain-specific datasets while preserving the accuracy of the model.
Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guide (2026.tacl-1)

Copied to clipboard

Challenge: Pre-trained language models provide strong foundations, but effective adaptation under data scarcity requires efficient and efficient fine-tuning techniques.
Approach: They propose to review parameter-efficient fine-tuning techniques that lower training and deployment costs and domain and cross-lingual adaptation methods for both encoder and decoder models.
Outcome: The proposed techniques lower training and deployment costs, domain and cross-lingual adaptation methods, and model specialization strategies.
Towards more equitable question answering systems: How much more data do you need? (2021.acl-short)

Copied to clipboard

Challenge: Question answering datasets in English are relatively new, but lack of linguistic diversity in the field is a challenge.
Approach: They propose to use translation and cross-lingual transfer to produce QA systems in multiple languages to improve their performance.
Outcome: The proposed approaches take advantage of existing resources to produce QA systems in multiple languages.
SynDARin: Synthesising Datasets for Automated Reasoning in Low-Resource Languages (2025.coling-main)

Copied to clipboard

Challenge: Question Answering datasets are scarce for languages other than English due to the cost and difficulties of collection and manual annotation.
Approach: They propose a method for generating and validating QA datasets for low-resource languages . they use English data as context to generate synthetic multiple-choice (MC) question-answer pairs .
Outcome: The proposed method maintains quality, reduces likelihood of factual errors, and circumvents costly annotation.
Learning with Limited Data for Multilingual Reading Comprehension (D19-1)

Copied to clipboard

Challenge: Existing approaches to support question answering in a new language with limited training resources introduce noises to the training data due to translation or generation errors.
Approach: They propose a weakly-supervised framework that quantifies noises from automatically generated labels to deemphasize or fix noisy data in training.
Outcome: The proposed framework can deemphasize or fix noisy data in training on low-resource languages with varying similarity to English.
Question-Answering in a Low-resourced Language: Benchmark Dataset and Models for Tigrinya (2023.acl-long)

Copied to clipboard

Challenge: Question-Answering (QA) has seen significant advances in recent years, achieving near human-level performance over some benchmarks.
Approach: They propose to use a native QA dataset for an East African language, Tigrinya, to build similar resources for related languages.
Outcome: The proposed method is applicable to constructing similar resources for related languages.
Making More of Little Data: Improving Low-Resource Automatic Speech Recognition Using Data Augmentation (2023.acl-long)

Copied to clipboard

Challenge: Using self-training or text-to-speech (TTS) to improve low-resource ASR performance is costly and can lead to catastrophic forgetting.
Approach: They examine whether data augmentation techniques could help improve low-resource ASR performance . they use self-training to generate transcriptions, which are combined with original data to train new system .
Outcome: The proposed approach yields a 20.5% reduction in WER compared to a system trained on 24 minutes of manually transcribed speech.
Accurate Training of Web-based Question Answering Systems with Feedback from Ranked Users (2023.acl-industry)

Copied to clipboard

Challenge: Recent work shows that large-scale annotated datasets are essential for training state-of-the-art Question Answering (QA) models.
Approach: They use large-scale annotated datasets to train question answering models . they use feedback data collected from deployed QA systems to provide cheaper supervision .
Outcome: The proposed model improves on the large scale annotated datasets from QA systems . the proposed model can be easily supervised on large-scale unlabeled web data .
Chat or Learn: a Data-Driven Robust Question-Answering System (2020.lrec-1)

Copied to clipboard

Challenge: QA systems tend to perform poorly at chitchat, while data-driven chatbots are typically user-friendly but not goal-oriented .
Approach: They propose to use a controller to perform dialogue act classification and feed user input either to a sequence-to-sequence chatbot or to QA systems.
Outcome: The proposed system is a spoken QA application for the Google Home smart speaker.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations