FastCorrect 2: Fast Error Correction on Multiple Candidates for Automatic Speech Recognition (2021.findings-emnlp)
Copied to clipboard
Yichong Leng, Xu Tan, Rui Wang, Linchen Zhu, Jin Xu, Wenjie Liu, Linquan Liu, Xiang-Yang Li, Tao Qin, Edward Lin, Tie-Yan Liu
| Challenge: | Error correction is widely used in automatic speech recognition (ASR) to post-process the generated sentence. |
| Approach: | They propose a fast correction model that takes multiple ASR candidates as input for better correction accuracy. |
| Outcome: | The proposed model can reduce the word error rate (WER) with multiple candidates by 3.2% and 2.6%. |
Similar Papers
Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have promoted generative error correction (GER) for automatic speech recognition (ASR). |
| Approach: | They propose a multimodal LLM to receive source speech as extra input and reformat it as a cloze test with logits calibration to remove input information redundancy and simplify GER with clear instructions. |
| Outcome: | The proposed model improves on 9 popular ASR datasets and is faster than vanilla GER. |
Mask the Correct Tokens: An Embarrassingly Simple Approach for Error Correction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Text error correction methods usually use the source (incorrect) sentence as encoder input and generate the target (correct) sentences through the decoder. |
| Approach: | They propose a method to correct errors in text sequences by randomly masking out the correct tokens in the source sentence. |
| Outcome: | The proposed method improves accuracy on Mandarin and English datasets with autoregressive and non-autoregressive generation models. |
ASR-EC Benchmark: Evaluating Large Language Models on Chinese ASR Error Correction (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Automatic Speech Recognition (ASR) systems have a substantial number of erroneous recognition due to environmental noise, ambiguity, etc. |
| Approach: | They use a benchmark dataset to analyze ASR errors in the Chinese language . they then apply large language models to correct ASR error correction . |
| Outcome: | The proposed method is based on a dataset of ASR errors in the Chinese language . it shows prompting is not effective for ASR error correction . |
Evaluating Open-Source ASR Systems: Performance Across Diverse Audio Conditions and Error Correction Methods (2025.coling-main)
Copied to clipboard
| Challenge: | Automated speech recognition (ASR) systems are able to transcribe spontaneous human conversations with high accuracy. |
| Approach: | They evaluate the accuracy of open source automatic speech recognition systems across conversational speech datasets and explore the potential of ASR ensembling and post-ASR correction methods to improve transcription accuracy. |
| Outcome: | The proposed methods highlight the need for robust error correction techniques and address demographic biases to enhance ASR performance and inclusivity. |
CoVoGER: A Multilingual Multitask Benchmark for Speech-to-text Generative Error Correction with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models can fix recognition or translation errors that traditional rescoring cannot fix. |
| Approach: | They propose a benchmark for GER that covers both ASR and speech-to-text translation across 15 languages and 28 language pairs. |
| Outcome: | The proposed benchmark is built on common voice 20.0 and CoVoST-2 with Whisper and SeamlessM4T. |
Multi-pass Decoding for Grammatical Error Correction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Seq2edit models decode only once without aware of subsequent tokens. |
| Approach: | They propose to iteratively refine the correction results of seq2seq models via Multi-Pass Decoding (MPD) to improve performance, but MPD increases inference costs . they propose to merge the source input and previous round correction result into one sequence. |
| Outcome: | Experiments on the CoNLL-14 and BEA-19 test set show that the proposed approach improves over baselines. |
Alirector: Alignment-Enhanced Chinese Grammatical Error Corrector (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to address overcorrection in Chinese grammatical error correction (CGEC) are difficult to adapt to decoder-only large language models (LLMs). |
| Approach: | They propose an alignment-enhanced corrector for the overcorrection problem that applies to both Seq2Seq models and decoder-only large language models (LLMs). |
| Outcome: | The proposed corrector alleviates the overcorrection problem in Chinese grammatical error correction (CGEC) using generative models and decoder-only large language models. |
Optimized Tokenization for Transcribed Error Correction (2023.emnlp-main)
Copied to clipboard
| Challenge: | transcribed-like data is often used to correct recurring errors, but training with synthetic data is difficult. |
| Approach: | They propose to use synthetic transcribed-like data to train error correction models . they show that synthetic data outperforms the common approach of random perturbations . |
| Outcome: | The proposed method outperforms the common method using random perturbations in transcribed data and language-specific adjustments to the vocabulary of a BPE tokenizer. |
Efficient Grammatical Error Correction Via Multi-Task Training and Optimized Training Schedule (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent research has focused on using synthetic data for grammatical error correction . lack of annotated training data hinders progress in the field . |
| Approach: | They propose auxiliary tasks that exploit alignment between original and corrected sentences . they propose a sequence-to-sequence problem and perform multi-task training . |
| Outcome: | The proposed auxiliary tasks outperform the best models with a BART-based model on 11B parameters. |
Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition (2024.lrec-main)
Copied to clipboard
Yash Jain, David M. Chan, Pranav Dheram, Aparna Khare, Olabanji Shonibare, Venkatesh Ravichandran, Shalini Ghosh
| Challenge: | Existing methods for pre-training for automatic speech recognition (ASR) focus on single-stage pre-train followed by fine-tuning on downstream task. |
| Approach: | They propose a multi-modal pre-training method that combines unsupervised pre-training with translation-based supervised mid-training. |
| Outcome: | The proposed method improves WERs by 38.45% over baselines on both Librispeech and SUPERB. |