| Challenge: | Domain-agnostic Automatic Speech Recognition systems often mistranscribe domain-specific words and phrases. |
| Approach: | They propose a method for handling ASR errors in named entities, specifically person names, for a voice-based collaboration assistant. |
| Outcome: | The proposed method improves accuracy by 40.8% on a voice-based collaboration assistant. |
Similar Papers
Optimizing Entity Resolution in Voice Interfaces: An ASR-Aware Entity Reference Expansion Approach (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Automatic Speech Recognition (ASR) errors in voice-based dialog systems pose significant impediments to downstream tasks. |
| Approach: | They propose an automatic speech recognition (ASR) error-aware loss function to inject failed mentions and resolved entity names into the knowledge graph to enhance its awareness of unresolved mentions. |
| Outcome: | The proposed system enhances the knowledge graph's awareness of unresolved mentions by injecting pairs of failed mentions and resolved entities into the knowledge map. |
Why Aren’t We NER Yet? Artifacts of ASR Errors in Named Entity Recognition in Spontaneous Speech Transcripts (2023.acl-long)
Copied to clipboard
Piotr Szymański, Lukasz Augustyniak, Mikolaj Morzy, Adrian Szymczak, Krzysztof Surdyk, Piotr Żelasko
| Challenge: | despite advances in language models, the transcript of spontaneous human-human conversations remains an insurmountable challenge for most models. |
| Approach: | They examine the relationship between ASR and NER errors which limit NER models' ability to recover entity mentions from spontaneous speech transcripts. |
| Outcome: | The proposed model fails even if no word errors are introduced by the ASR . the proposed model's performance deteriorates when applied to the ASL outputs . |
Noise Robust Named Entity Understanding for Voice Assistants (2021.naacl-industry)
Copied to clipboard
Deepak Muralidharan, Joel Ruben Antony Moniz, Sida Gao, Xiao Yang, Justine Kao, Stephen Pulman, Atish Kothari, Ray Shen, Yinying Pan, Vivek Kaul, Mubarak Seyed Ibrahim, Gang Xiang, Nan Dun, Yidan Zhou, Andy O, Yuan Zhang, Pooja Chitkara, Xuan Wang, Alkesh Patel, Kushal Tayal, Roger Zheng, Peter Grasch, Jason D Williams, Lin Li
| Challenge: | Named Entity Recognition and Entity Linking are challenging for voice assistants . utterances are relatively short, so there is not much context to help disambiguate . |
| Approach: | They propose a Named Entity Understanding system that combines NER and EL in a joint reranking module. |
| Outcome: | The proposed framework improves NER accuracy by up to 3.13% and EL accuracy by 3.6% in F1 score . it also leads to better accuracies in other natural language understanding tasks . |
Chinese Spoken Named Entity Recognition in Real-world Scenarios: Dataset and Approaches (2024.findings-acl)
Copied to clipboard
| Challenge: | Current Chinese Spoken NER datasets are laboratory-controlled and are limited in topics. |
| Approach: | They propose to use Chinese Spoken NER datasets to extract entities from speech to help voice assistants better grasp the intent behind user's questions and instructions. |
| Outcome: | The proposed methods improve on self-training-asr and mapping then distilling, and even compared with GPT4.0, they achieve better results. |
Generative Annotation for ASR Named Entity Correction (2025.emnlp-main)
Copied to clipboard
Yuanchang Luo, Daimeng Wei, Shaojun Li, Hengchao Shang, Jiaxin Guo, Zongyao Li, Zhanglin Wu, Xiaoyu Chen, Zhiqiang Rao, Jinlong Yang, Hao Yang
| Challenge: | Existing named entity correction models fail to transcribe domain-speciffcnamed entities when theforms of the wrongly-transcribed words and the ground-truth entity are signiffcantly different. |
| Approach: | They propose a method that utilizes speech sound features to retrieve candidate entities . it uses speech sound feature to annotate entityerrors in ASR transcripts . |
| Outcome: | The proposed method can bring signiffcant improvement to entity accuracy. |
Entity Resolution in Open-domain Conversations (2021.naacl-industry)
Copied to clipboard
Mingyue Shang, Tong Wang, Mihail Eric, Jiangning Chen, Jiyang Wang, Matthew Welch, Tiantong Deng, Akshay Grewal, Han Wang, Yue Liu, Yang Liu, Dilek Hakkani-Tur
| Challenge: | Recent work on incorporating external knowledge into the response generation models has attracted great interest. |
| Approach: | They propose a neural entity linking approach to incorporate external knowledge into the response generation models to improve the relevancy of retrieved knowledge. |
| Outcome: | The proposed approach outperforms the baseline model by 62.8% relative to the baseline. |
Improving Named Entity Recognition via Bridge-based Domain Adaptation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition use pre-training language models to represent words, leading to entity type misclassification. |
| Approach: | They propose a model-agnostic framework called MoCL for cross-domain named entity recognition to refine the original representations and combine it with two distinct cross- domain NER methods and two pre-training language models to explore its generalization ability. |
| Outcome: | The proposed framework is model-agnostic and can be used to generalize and refine existing models. |
Named Entity Recognition for Entity Linking: What Works and What’s Next (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Entity Linking (EL) systems have achieved impressive results on standard benchmarks thanks to the contextualized representations provided by recent pretrained language models. |
| Approach: | They propose to exploit Named Entity Recognition (NER) to narrow the gap between EL systems trained on high and low amounts of labeled data. |
| Outcome: | The proposed model can be exploited to narrow the gap between EL systems trained on high and low amounts of labeled data. |
DeRAGEC: Denoising Named Entity Candidates with Synthetic Rationale for ASR Error Correction (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that postprocessing speech recognition transcriptions with large language models can significantly enhance the accuracy of Automatic Speech Recognition (ASR). |
| Approach: | They propose a method to improve Named Entity (NE) correction in Automatic Speech Recognition systems by leveraging phonetic similarity and augmented definitions. |
| Outcome: | The proposed method outperforms baseline methods on common voice and STOP datasets and achieves a 28% reduction in WER and NE hit ratio. |
Improving Named Entity Recognition with Attentive Ensemble of Syntactic Information (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have shown that named entity recognition (NER) is effective in encoding and aggregating syntactic information, but they lack the appropriate knowledge to model such properties. |
| Approach: | They propose to leverage syntactic information by leveraging attentive ensembles to model NER . they propose key-value memory networks, syntax attention and gate mechanism for encoding, weighting and aggregating syntaktic information. |
| Outcome: | The proposed model outperforms previous studies on six English and Chinese benchmark datasets. |