KT-Speech-Crawler: Automatic Dataset Construction for Speech Recognition from YouTube Videos (D18-2)
Copied to clipboard
| Challenge: | KT-Speech-Crawler is an automated dataset building tool for speech recognition. |
| Approach: | They propose an approach for automatic dataset construction for speech recognition by crawling YouTube videos. |
| Outcome: | The proposed algorithm can obtain 150 hours of transcribed speech in a day with an estimated 3.5% word error rate. |
Similar Papers
The Spoken Language Understanding MEDIA Benchmark Dataset in the Era of Deep Learning: data updates, training and evaluation tools (2022.lrec-1)
Copied to clipboard
Gaëlle Laperrière, Valentin Pelloin, Antoine Caubrière, Salima Mdhaffar, Nathalie Camelin, Sahar Ghannay, Bassam Jabaian, Yannick Estève
| Challenge: | a growing number of studies address the spoken language understanding domain through a simple task like speech intent detection. |
| Approach: | They focus on the french MEDIA SLU dataset, which is distributed since 2005 . they propose a recipe for its use, including data preparation, training and evaluation scripts . |
| Outcome: | The MEDIA SLU dataset is used as a benchmark dataset for a large number of research projects. |
A Crowdsourced Open-Source Kazakh Speech Corpus and Initial Speech Recognition Baseline (2021.eacl-main)
Copied to clipboard
Yerbolat Khassanov, Saida Mussakhojayeva, Almas Mirzakhmetov, Alen Adiyev, Mukhamet Nurpeiissov, Huseyin Atakan Varol
| Challenge: | The Kazakh speech corpus contains over 153,000 utterances spoken by participants from different regions and age groups, as well as both genders. |
| Approach: | They propose to build an open-source Kazakh speech corpus for the Kazakh language that contains over 153,000 transcribed audio . they describe the data collection and preprocessing procedures followed by a description of the database specifications. |
| Outcome: | The Kazakh speech corpus contains over 153,000 utterances spoken by participants from different regions and age groups, as well as both genders. |
Tutorial: End-to-End Speech Translation (2021.eacl-tutorials)
Copied to clipboard
| Challenge: | Speech translation is the translation of speech in one language typically to text in another, traditionally accomplished through a combination of automatic speech recognition and machine translation. |
| Approach: | This tutorial introduces the techniques used in cutting-edge research on speech translation. |
| Outcome: | The proposed models achieve state-of-the-art performance with end-to-end speech translation for both high- and low-resource languages. |
Evaluating Automatic Speech Recognition Systems for Korean Meteorological Experts (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using a dataset of Korean weather queries, we find that automatic speech recognition systems fail on specialized vocabulary. |
| Approach: | They propose an evaluation dataset of Korean weather queries . the dataset was recorded by diverse native speakers following pronunciation guidelines . |
| Outcome: | The proposed model reduces error rates on meteorological terms and improves overall recognition accuracy. |
Massive End-to-end Speech Recognition Models with Time Reduction (2024.naacl-long)
Copied to clipboard
Weiran Wang, Rohit Prabhavalkar, Haozhe Shan, Zhong Meng, Dongseong Hwang, Qiujia Li, Khe Chai Sim, Bo Li, James Qin, Xingyu Cai, Adam Stooke, Chengjian Zheng, Yanzhang He, Tara Sainath, Pedro Moreno Mengibar
| Challenge: | Using the neural architecture of Google’s universal speech model, we reduce the frame rate and speed up training and inference. |
| Approach: | They propose to use the neural architecture of Google’s universal speech model with additional funnel pooling layers to significantly reduce the frame rate and speed up training and inference. |
| Outcome: | The proposed methods work with both connectionist temporal classification (CTC) and RNN-Transducer (RNN-T) and over two domains. |
Finding Spoken Identifications: Using GPT-4 Annotation for an Efficient and Fast Dataset Creation Pipeline (2024.lrec-main)
Copied to clipboard
Maliha Jahan, Helin Wang, Thomas Thebaud, Yinglun Sun, Giang Ha Le, Zsuzsanna Fagyal, Odette Scharenborg, Mark Hasegawa-Johnson, Laureano Moro Velazquez, Najim Dehak
| Challenge: | Existing datasets that are limited to a few dialects, ethnicities, and age groups are not annotated considering these factors. |
| Approach: | They propose a semi-automated dataset creation pipeline that leverages large language models to perform two complex annotation tasks using human annotations as ground truths. |
| Outcome: | The proposed pipeline reduces time required for the filtering and tagging tasks while losing no important information. |
Speech Foundation Models and Crowdsourcing for Efficient, High-Quality Data Collection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for crowdsourcing data collection require a human workforce, which is hard to sustain. |
| Approach: | They propose to use Speech Foundation Models to automate validation processes . they find that SFMs can reduce reliance on human validation . |
| Outcome: | The proposed model reduces the reliance on human validation without degrading the quality of the final data. |
Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languages (2025.acl-long)
Copied to clipboard
Ashwin Sankar, Sparsh Jain, Nikhil Narasimhan, Devilal Choudhary, Dhairya Suman, Mohammed Safi Ur Rahman Khan, Anoop Kunchukuttan, Mitesh M Khapra, Raj Dabre
| Challenge: | Existing datasets that cover only a fraction of Indian languages lack the breadth needed to generalize beyond curated benchmarks. |
| Approach: | They propose to build the largest speech translation dataset for Indian languages . they use a three-step methodology to gather data and train a model that performs better . |
| Outcome: | The proposed model improves on existing models and is open-source with permissive licenses. |
Speak: A Toolkit Using Amazon Mechanical Turk to Collect and Validate Speech Audio Recordings (2022.lrec-1)
Copied to clipboard
| Challenge: | Speak is a toolkit that allows researchers to crowdsource speech recordings using Amazon Mechanical Turk (MTurk). |
| Approach: | They propose to use Amazon Mechanical Turk to crowdsource speech recordings . they use various measures to ensure that the recordings are of adequate quality . |
| Outcome: | Speak is an open-source toolkit that allows researchers to crowdsource speech recordings using Amazon Mechanical Turk (MTurk). |
Fairseq S2T: Fast Speech-to-Text Modeling with Fairseq (2020.aacl-demo)
Copied to clipboard
| Challenge: | End-to-end sequence-to sequence (S2S) modeling has witnessed rapid growth in speech-totext (ST) tasks. |
| Approach: | They introduce fairseq S2T, a fairsq extension for speech-to-text modeling tasks such as end-to end speech recognition and speech-text translation. |
| Outcome: | The proposed extension provides end-to-end workflows from data pre-processing, model training to offline (online) inference. |