Challenge: Language documentation involves recording the speech of native speakers.
Approach: They propose to use a neural network architecture to model phonemes and tones versus modelling them separately.
Outcome: The proposed method improves efficiency, minimizes typographical errors and maintains transcription faithfulness to acoustic signal while highlighting phonetic and phonemic facts for linguistic consideration.

Similar Papers

Phoneme transcription of endangered languages: an evaluation of recent ASR architectures in the single speaker scenario (2022.findings-acl)

Copied to clipboard

Challenge: Recent work on phonetic transcription is reported to be the bottleneck in endangered languages . however, when a single speaker is involved, small amounts of training are needed .
Approach: They compare automatic speech recognition (ASR) approaches to speaker-dependent phonetic transcription using a common dataset of 11 languages.
Outcome: The proposed system handles morphologically complex languages and writing systems for which no pronunciation dictionary exists.
A Very Low Resource Language Speech Corpus for Computational Language Documentation Experiments (L18-1)

Copied to clipboard

Challenge: a new study aims to document endangered languages using a speech corpus . linguistic documentation is limited to the phonetic, lexical and syntactic levels .
Approach: They propose to use a speech corpus to document endangered languages in field . they propose to collect 5k speech utterances aligned to French text translations .
Outcome: The proposed language corpus is used to document endangered languages in field linguists . it is multilingual and contains 5k speech utterances aligned to french text translations - the authors show it can be used in a zero-resource task .
Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach (2024.emnlp-main)

Copied to clipboard

Challenge: Generating speech through a pipeline that operates at the text level typically loses nuances, intonations, and non-verbal vocalizations.
Approach: They show that fine-tuning speech representation models on phoneme classification leads to more context-invariant representations, and language models trained on these units achieve comparable lexical comprehension to ones trained on hundred times more data.
Outcome: Recent advances in speech representation modeling have shown that learning language directly from speech is feasible.
Enhancing Cross-lingual Transfer via Phonemic Transcription Integration (2023.findings-acl)

Copied to clipboard

Challenge: Previous cross-lingual transfer methods are limited to orthographic representation learning via textual scripts.
Approach: They propose a phonemic transcription framework that incorporates phonemic translations as an additional linguistic modality beyond the orthographic transcriptions for cross-lingual transfer.
Outcome: The proposed framework captures local one-to-one alignment between two different modalities and integrates bilingual dictionaries into multilingual contexts.
Hard to Be Heard: Phoneme-Level ASR Analysis of Phonologically Complex, Low-Resource Endangered Languages (2026.findings-acl)

Copied to clipboard

Challenge: a phoneme-level analysis of automatic speech recognition (ASR) is performed on two low-resource, typologically complex East Caucasian languages.
Approach: They propose a phoneme-level analysis of automatic speech recognition for two East Caucasian languages, Archi and Rutul.
Outcome: The proposed model improves on existing models and improves in low-resource settings.
What Do Neural Speech Models Know About Phonology? Evidence from Structured Phoneme Confusions (2026.findings-acl)

Copied to clipboard

Challenge: acoustic and phonological models of speech recognition are often limited to the phoneme level . a recent study has shown that phoneme confusions are strongly structured in phonology space .
Approach: They adopt a featural representation of phonemes grounded in phonological theory which models speech sounds as structured bundles of distinctive articulatory and acoustic properties.
Outcome: The proposed model allows us to analyse phoneme confusions at a finer granularity and to investigate whether certain phonological features are more vulnerable than others.
Exploring Phoneme-Level Speech Representations for End-to-End Speech Translation (P19-1)

Copied to clipboard

Challenge: Previous work on end-to-end translation from speech uses frame-level features as speech representations, which creates longer, sparser sequences than text.
Approach: They propose a method to generate compressed phoneme-like speech representations that generate shorter, higher-level source sequences for translation.
Outcome: The proposed method improves translation performance by 5 BLEU on high and low resource languages and reduces training time by 60%.
Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Features (2022.acl-long)

Copied to clipboard

Challenge: Recent advances in text-to-speech systems allow for speech synthesis with unprecedented quality and controllability.
Approach: They use embeddings derived from articulatory vectors rather than phoneme identities to learn phoneme representations that hold across languages.
Outcome: The proposed models fine-tuned on 30 minutes of data in a previously unseen language with language agnostic meta learning.
Textual Supervision for Visually Grounded Spoken Language Understanding (2020.findings-emnlp)

Copied to clipboard

Challenge: a new approach to spoken language understanding extracts semantic information directly from speech without relying on transcriptions.
Approach: They propose to use textual supervision to train visually-grounded models of spoken language understanding without relying on transcriptions.
Outcome: The proposed model improves when enough text is available, the study shows . compared with pipeline-based models, the pipeline approach performs better when enough data is available .
Prompting with Phonemes: Enhancing LLMs’ Multilinguality for Non-Latin Script Languages (2025.naacl-long)

Copied to clipboard

Challenge: Multilingual LLMs have achieved remarkable benchmark performance, but continue to underperform on non-Latin script languages.
Approach: They propose to integrate phonemic transcriptions as complementary signals to induce script-invariant representations by integrating phonemic and orthographic transcriptions.
Outcome: The proposed approach improves performance for Latin and non-Latin script languages, with 12.6% performance improvement and 15.1% performance improvement compared to randomized ICL retrieval.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations