Using the LARA Little Prince to compare human and TTS audio quality (2022.lrec-1)
Copied to clipboard
Elham Akhlaghi, Ingibjörg Iða Auðunardóttir, Anna Bączkowska, Branislav Bédi, Hakeem Beedar, Harald Berthelsen, Cathy Chua, Catia Cucchiarin, Hanieh Habibi, Ivana Horváthová, Junta Ikeda, Christèle Maizonniaux, Neasa Ní Chiaráin, Chadi Raheb, Manny Rayner, John Sloan, Nikos Tsourakis, Chunlin Yao
| Challenge: | A popular idea in Computer Assisted Language Learning (CALL) is to use multimodal annotated texts to support reading. |
| Approach: | They propose to use an open source platform to create good quality audio for L2 learning . they use four passages from LARA versions of Saint-Exupèry’s “Le petit prince” to instantiate the 2x2 cross product of dialogue, not-dialogue and humour, not humor. |
| Outcome: | The proposed method is based on a web form and ten languages. |
Similar Papers
Computational Narrative Understanding for Expressive Text-to-Speech (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in text-to-speech systems have been driven by large, multi-domain speech corpora. |
| Approach: | They propose a large-scale 5.3K hours of expressive speech drawn from character quotations . they fine-tune a flow-matching model and train from scratch . |
| Outcome: | The proposed model improves expressivity and intelligibility while training from scratch improves expressiveness of an autoregressive model. |
How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMs (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent research has focused on literary machine translation (MT) but evaluation of literary MT remains an open problem. |
| Approach: | They propose a paragraph-level parallel corpus containing verified human translations and 13k evaluated sentences across four language pairs. |
| Outcome: | The proposed corpus compares human evaluations with students and professionals . it shows that the adequacy of human evaluation is controlled by two factors . |
Scaling Under-Resourced TTS: A Data-Optimized Framework with Advanced Acoustic Modeling for Thai (2025.acl-industry)
Copied to clipboard
| Challenge: | Text-to-speech (TTS) systems are limited by limited data and linguistic complexities. |
| Approach: | They propose a data-optimized framework with an advanced acoustic model to build high-quality TTS systems for low-resource scenarios. |
| Outcome: | The proposed framework enables zero-shot voice cloning and improved performance across diverse client applications, including finance, healthcare, education, and law. |
Bahasa Harmony: A Comprehensive Dataset for Bahasa Text-to-Speech Synthesis with Discrete Codec Modeling of EnGen-TTS. (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing text-to-speech (TTS) systems often fail to address the needs of Bahasa, resulting in limited adaptability, linguistic richness, or efficiency. |
| Approach: | They propose a Bahasa text-to-speech dataset and a novel TTS model, EnGen-TTS, which enhance the quality and versatility of synthetic speech in the Bahasan language. |
| Outcome: | The proposed model outperforms existing models even without fine-tuning and achieves a mean opinion score of 4.45 0.13. |
SpeechWeave: Diverse Multilingual Synthetic Text & Audio Data Generation Pipeline for Training Text to Speech Models (2025.acl-industry)
Copied to clipboard
| Challenge: | Text-to-Speech (TTS) training requires extensive and diverse text and speech data. |
| Approach: | They propose a synthetic speech data generation pipeline that generates multilingual, domain-specific datasets for TTS training. |
| Outcome: | The proposed pipeline generates data that is 10–48% more diverse than baseline across various linguistic and phonetic metrics, along with speaker-standardized speech audio while generating approximately 97% correctly normalized text. |
Prosody-TTS: Improving Prosody with Masked Autoencoder and Conditional Diffusion Model For Expressive Text-to-Speech (2023.findings-acl)
Copied to clipboard
| Challenge: | Expressive text-to-speech aims to generate high-quality samples with rich prosody . prosodic attributes in highly dynamic voices are difficult to capture and model without intonation . |
| Approach: | They propose a pipeline that enhances prosody modeling and sampling by introducing a self-supervised masked autoencoder and a diffusion model to sample diverse prosodic patterns within the latent space. |
| Outcome: | The proposed pipeline achieves new state-of-the-art in text-to-speech with natural and expressive synthesis. |
An Automated End-to-End Open-Source Software for High-Quality Text-to-Speech Dataset Generation (2024.lrec-main)
Copied to clipboard
Ahmet Gunduz, Kamer Ali Yuksel, Kareem Darwish, Golara Javadi, Fabio Minazzi, Nicola Sobieski, Sébastien Bratières
| Challenge: | Text-to-speech (TTS) models require data availability and quality of training data. |
| Approach: | They propose an end-to-end tool to generate high-quality datasets for text-to speech models . language-specific phoneme distribution is integrated into sample selection, they argue . |
| Outcome: | The proposed tool aims to streamline the dataset creation process for voice-based technologies by integrating language-specific phonemes into sample selection and quality assurance of recordings. |
Toward Robust Evaluation for Multilingual Grammatical Error Correction: Can Large Language Models Replace Human References? (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work has shown that using aclosest-gold reference yields more accurate performance estimates, but producing such references for each system individually is costly. |
| Approach: | They propose a method for generating closest-gold references by prompting a large language model with system outputs and a standard reference-based evaluations show weak or no correlation. |
| Outcome: | The proposed method outperforms state-of-the-art models on 14 languages across 14 benchmarks. |
VoxpopuliTTS: a large-scale multilingual TTS corpus for zero-shot speech generation (2025.coling-main)
Copied to clipboard
Wenrui Liu, Jionghao Bai, Xize Cheng, Jialong Zuo, Ziyue Jiang, Shengpeng Ji, Minghui Fang, Xiaoda Yang, Qian Yang, Zhou Zhao
| Challenge: | Existing multilingual TTS datasets are limited in speech generation fields due to lack of quality data. |
| Approach: | They propose to use 30,000 hours of high-quality speech data across 3 languages . they filter out low-quality text-text pairs and concatenate short transcripts . |
| Outcome: | The proposed dataset comprises 30,000 hours of high-quality speech data, across 3 languages with multiple speakers and styles, suitable for various speech tasks such as TTS and ASR. |
Real or Robotic? Assessing Whether LLMs Accurately Simulate Qualities of Human Responses in Human-LLM Dialogue (2026.findings-acl)
Copied to clipboard
Jonathan Ivey, Shivani Kumar, Jiayu Liu, Hua Shen, Sushrita Rakshit, Rohan Raju, Haotian Zhang, Aparna Ananthasubramaniam, Junghwan Kim, Bowen Yi, Dustin Wright, Abraham Israeli, Anders Giovanni Møller, Lechen Zhang, David Jurgens
| Challenge: | Recent work has sought to use large language models to simulate human-human and human-LLM interactions. |
| Approach: | They use a large-scale dataset to generate a paired LLM-LLM and human-LLm dialogues from the WildChat dataset and quantify how well they align with their human counterparts. |
| Outcome: | The proposed models perform similarly in simulating English, Chinese, and Russian dialogues. |