Challenge: End-to-end (E2E) models are replacing hybrid models for automatic speech recognition tasks.
Approach: They propose a method to optimize E2E models for automatic speech recognition . they propose MED-IT, a multi-turn consultation speech dataset .
Outcome: The proposed method improves on subsets of rare words appearing in training speech.

Similar Papers

Speech Translation and the End-to-End Promise: Taking Stock of Where We Are (2020.acl-main)

Copied to clipboard

Challenge: Until recently, the only feasible approach to translating acoustic speech signals into text was the cascaded approach.
Approach: They propose a classification of the main challenges of traditional approaches to speech translation . they argue that end-to-end models fall short due to compromises made to address data scarcity .
Outcome: This paper provides a brief survey of the main challenges of traditional approaches in speech translation . it reveals that many end-to-end models fail due to compromises made to address data scarcity.
Tutorial: End-to-End Speech Translation (2021.eacl-tutorials)

Copied to clipboard

Challenge: Speech translation is the translation of speech in one language typically to text in another, traditionally accomplished through a combination of automatic speech recognition and machine translation.
Approach: This tutorial introduces the techniques used in cutting-edge research on speech translation.
Outcome: The proposed models achieve state-of-the-art performance with end-to-end speech translation for both high- and low-resource languages.
MultiMed: Multilingual Medical Speech Recognition via Attention Encoder Decoder (2025.acl-industry)

Copied to clipboard

Challenge: Multilingual automatic speech recognition (ASR) in the medical domain is a critical foundational task, serving a wide range of downstream applications such as speech translation, spoken language understanding, and voice-activated assistants.
Approach: They present the first multilingual medical ASR dataset and the first collection of small-to-large end-to end medical APR models spanning five languages: Vietnamese, English, German, French, and Mandarin Chinese.
Outcome: The proposed model covers Vietnamese, English, German, French, and Mandarin Chinese, and is the first multilingual ASR dataset across five languages.
Streaming Models for Joint Speech Recognition and Translation (2021.eacl-main)

Copied to clipboard

Challenge: Using end-to-end models for speech translation has become a focus of the ST community . cascaded models have the advantage of including automatic speech recognition output .
Approach: They propose a model that condenses sound waves into translated text and integrates automatic speech recognition outputs into the models.
Outcome: The proposed model is statistically similar to cascading models, but has half the number of parameters.
Worse WER, but Better BLEU? Leveraging Word Embedding as Intermediate in Multitask End-to-End Speech Translation (2020.acl-main)

Copied to clipboard

Challenge: Existing studies show that multitask learning improves speech translation performance by utilizing word embedding as the intermediate.
Approach: They propose to use word embedding as an intermediate to improve multitask ST models by utilizing word embeds as input.
Outcome: The proposed model outperforms existing models with sufficient training data but is still lacking in the low-resource scenario.
A Purely End-to-End System for Multi-speaker Speech Recognition (P18-1)

Copied to clipboard

Challenge: Existing methods for multi-speaker speech recognition require isolated source signals or senone alignments for effective learning.
Approach: They propose a sequence-to-sequence framework to decode multiple label sequences from a single speech sequence by unifying source separation and speech recognition functions in an end-to end manner.
Outcome: The proposed model improves on existing models by 83.1% relative to previous models with explicit separation and recognition modules.
Adaptive Feature Selection for End-to-End Speech Translation (2020.findings-emnlp)

Copied to clipboard

Challenge: End-to-end speech translation (E2E) models that directly maps audio to a foreign text are not efficient.
Approach: They propose adaptive feature selection (AFS) for encoder-decoder based E2E ST.
Outcome: The proposed model outperforms the existing model on LibriSpeech En-Fr and MuST-C with a BLEU score of 18.56.
Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on Yolóxochitl Mixtec (2021.eacl-main)

Copied to clipboard

Challenge: End-to-end ASR systems that eschew linguistic resources but are more dependent on large-data settings are suggested as a solution to EL documentation bottlenecks.
Approach: They propose to build an end-to-end ASR system that is reproducible by the ASR community and propose a novice transcription correction task.
Outcome: The proposed method would mitigate bottlenecks and shortages in transcribers . it is based on a Yoloxóchitl Mixtec corpus and is reproducible by the ASR community.
End-to-End Bias Mitigation by Modelling Biases in Corpora (2020.acl-main)

Copied to clipboard

Challenge: Recent studies have shown that strong natural language understanding models are prone to relying on unwanted dataset biases without learning the underlying task.
Approach: They propose two learning strategies to train neural models that are more robust to dataset biases and transfer better to out-of-domain datasets.
Outcome: The proposed methods improve robustness in all settings and transfer better to out-of-domain datasets.
End-to-end ASR to jointly predict transcriptions and linguistic annotations (2021.naacl-main)

Copied to clipboard

Challenge: Existing models generate audio transcripts by sequentially producing likely graphemes, or multi-graphemic units, from which lexical items of a language can be recovered.
Approach: They propose a Transformer-based sequence-to-sequence model for automatic speech recognition that can produce high-quality transcriptions and linguistic annotations.
Outcome: The proposed model can produce high-quality transcriptions and linguistic annotations on Japanese and English audio datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations