What Do Neural Speech Models Know About Phonology? Evidence from Structured Phoneme Confusions (2026.findings-acl)
Copied to clipboard
| Challenge: | acoustic and phonological models of speech recognition are often limited to the phoneme level . a recent study has shown that phoneme confusions are strongly structured in phonology space . |
| Approach: | They adopt a featural representation of phonemes grounded in phonological theory which models speech sounds as structured bundles of distinctive articulatory and acoustic properties. |
| Outcome: | The proposed model allows us to analyse phoneme confusions at a finer granularity and to investigate whether certain phonological features are more vulnerable than others. |
Similar Papers
Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languages (2026.findings-acl)
Copied to clipboard
| Challenge: | a phoneme-level analysis of automatic speech recognition (ASR) is performed on two low-resource, typologically complex East Caucasian languages. |
| Approach: | They propose a phoneme-level analysis of automatic speech recognition for two East Caucasian languages, Archi and Rutul. |
| Outcome: | The proposed model improves on existing models and improves in low-resource settings. |
Analyzing analytical methods: The case of phonology in neural models of spoken language (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies have focused on the strengths and weaknesses of various methods for analyzing phonology representations. |
| Approach: | They propose to use diagnostic classifiers and representational similarity analysis to quantify to what extent phonemes and phoneme sequences are encoded. |
| Outcome: | The proposed method is based on two commonly applied techniques . it shows that global-scope methods yield more consistent and interpretable results . |
Language-specific Effects on Automatic Speech Recognition Errors for World Englishes (2022.coling-1)
Copied to clipboard
| Challenge: | Existing systems are not able to meet the needs of speakers of different demographic groups. |
| Approach: | They propose to analyze the performance of Otter’s automatic captioning system on native and non-native English speakers of different language background through a linguistic analysis of segment-level errors. |
| Outcome: | The proposed system predicts certain errors from the phonological structure of a speaker’s native language. |
Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach (2024.emnlp-main)
Copied to clipboard
| Challenge: | Generating speech through a pipeline that operates at the text level typically loses nuances, intonations, and non-verbal vocalizations. |
| Approach: | They show that fine-tuning speech representation models on phoneme classification leads to more context-invariant representations, and language models trained on these units achieve comparable lexical comprehension to ones trained on hundred times more data. |
| Outcome: | Recent advances in speech representation modeling have shown that learning language directly from speech is feasible. |
Identifying and typifying demographic unfairness in phoneme-level embeddings of self-supervised speech recognition models (2026.findings-acl)
Copied to clipboard
| Challenge: | a number of studies have been done to improve ASR for speaker groups, but there is still room for improvement . authors propose a framework typifying two types of error in phoneme embeddings . |
| Approach: | They propose a framework typifying two types of error that can occur in phoneme modeling . they propose random error/high variance in phonemes embedding vs systematic error/embedding bias . |
| Outcome: | The proposed framework typifies errors in phoneme modeling in ASR systems . it shows that training only on a single, typically disadvantaged SG improves performance . |
Why Aren’t We NER Yet? Artifacts of ASR Errors in Named Entity Recognition in Spontaneous Speech Transcripts (2023.acl-long)
Copied to clipboard
Piotr Szymański, Lukasz Augustyniak, Mikolaj Morzy, Adrian Szymczak, Krzysztof Surdyk, Piotr Żelasko
| Challenge: | despite advances in language models, the transcript of spontaneous human-human conversations remains an insurmountable challenge for most models. |
| Approach: | They examine the relationship between ASR and NER errors which limit NER models' ability to recover entity mentions from spontaneous speech transcripts. |
| Outcome: | The proposed model fails even if no word errors are introduced by the ASR . the proposed model's performance deteriorates when applied to the ASL outputs . |
How to Compare Automatically Two Phonological Strings: Application to Intelligibility Measurement in the Case of Atypical Speech (2020.lrec-1)
Copied to clipboard
| Challenge: | Atypical speech productions must be evaluated with regard to "typical" or "expected" productions . a first test of this method among healthy speakers and patients treated for cancer has proved its validity . |
| Approach: | They propose a method to evaluate "atypical" speech productions based on phonological transcriptions . authors propose to use phonology to compute distances between phonologic forms produced and expected . |
| Outcome: | The proposed method has been validated in a large population of healthy speakers and patients with cancer . it computes distances between phonological forms produced and expected from cost matrices based on features of phonemes . |
Phoneme transcription of endangered languages: an evaluation of recent ASR architectures in the single speaker scenario (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent work on phonetic transcription is reported to be the bottleneck in endangered languages . however, when a single speaker is involved, small amounts of training are needed . |
| Approach: | They compare automatic speech recognition (ASR) approaches to speaker-dependent phonetic transcription using a common dataset of 11 languages. |
| Outcome: | The proposed system handles morphologically complex languages and writing systems for which no pronunciation dictionary exists. |
Evaluating Open-Source ASR Systems: Performance Across Diverse Audio Conditions and Error Correction Methods (2025.coling-main)
Copied to clipboard
| Challenge: | Automated speech recognition (ASR) systems are able to transcribe spontaneous human conversations with high accuracy. |
| Approach: | They evaluate the accuracy of open source automatic speech recognition systems across conversational speech datasets and explore the potential of ASR ensembling and post-ASR correction methods to improve transcription accuracy. |
| Outcome: | The proposed methods highlight the need for robust error correction techniques and address demographic biases to enhance ASR performance and inclusivity. |
Are modern neural ASR architectures robust for polysynthetic languages? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Traditional morphological typology recognizes a range of morphology in the world's languages. |
| Approach: | They investigate the performance of modern automatic speech recognition architectures on morphologically complex languages. |
| Outcome: | The proposed architectures perform better on morphologically complex languages, the authors show . they show that they are less robust in managing high OOV rates for morphology complex languages . |