DiTReducio: A Training-Free Acceleration for DiT-Based TTS via Progressive Calibration (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing training-free acceleration approaches for text-to-speech models are constrained by training costs. |
| Approach: | They propose a training-free acceleration framework that compresses computations in DiT-based TTS models . they propose Temporal Skipping and Branch Skipping to eliminate redundant computations . |
| Outcome: | Experimental results show that the proposed framework reduces FLOPs and improves RTF by 37.1%. |
Similar Papers
F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching (2025.acl-long)
Copied to clipboard
| Challenge: | Recent research in Text-to-Speech (TTS) has experienced great advancement . current models can synthesize speech for any given text and mimic the speaker of audio prompt. |
| Approach: | They propose a fully non-autoregressive text-to-speech system based on flow matching with Diffusion Transformer (DiT) without complex designs such as duration model, text encoder, and phoneme alignment, the text input is simply padded with filler tokens to the same length as input speech, and then denoising is performed for speech generation. |
| Outcome: | The proposed system achieves an inference RTF of 0.15, which is greatly improved compared to state-of-the-art diffusion-based models. |
ViT-TTS: Visual Text-to-Speech with Scalable Diffusion Transformer (2023.emnlp-main)
Copied to clipboard
| Challenge: | Text-to-speech (TTS) performance has improved with the advent of denoising Diffusion Probabilistic Models . however, perceived quality of audio depends on content, pitch, rhythm, and energy . |
| Approach: | They propose a visual TTS model with scalable diffusion transformers that complement phoneme sequences with visual information to generate high-perceived audio. |
| Outcome: | The proposed model outperforms existing models regardless of visibility of the scene . it can generate high-perceived audio, opening up new avenues for AR and VR applications . |
Best of Both Worlds: Making High Accuracy Non-incremental Transformer-based Disfluency Detection Incremental (2021.acl-long)
Copied to clipboard
| Challenge: | Currently, Transformer-based text classifiers are not suitable for live incremental processing, operating only on the level of complete sentence inputs. |
| Approach: | They propose to introduce a method for word-by-word left-to-right incremental processing to Transformers such as BERT, models without an intrinsic sense of linear order. |
| Outcome: | The proposed method maintains high non-incremental performance while operating strictly incrementally. |
CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers and Consistency Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Neural Text-to-Speech systems are a promising approach for high-fidelity speech synthesis . but the efficiency of multi-step sampling in Diffusion Models presents challenges . |
| Approach: | They propose a novel architecture grounded in consistency models to improve model convergence. |
| Outcome: | The proposed architecture achieves top-quality speech synthesis in fewer steps without adversarial training or pre-trained model dependencies. |
A Fast and High-quality Text-to-Speech Method with Compressed Auxiliary Corpus and Limited Target Speaker Corpus (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to generate high-quality speech with limited target speaker corpus require extensive training data. |
| Approach: | They propose an auxiliary corpus compression algorithm that reduces the training cost while the naturalness of synthesized speech is not significantly degraded. |
| Outcome: | The proposed method significantly reduces training costs while maintaining the naturalness of synthesized speech. |
ControlAudio: Tackling Text-Guided, Timing-Indicated and Intelligible Audio Generation via Progressive Diffusion Modeling (2026.acl-long)
Copied to clipboard
| Challenge: | Recent efforts on text-to-audio generation are exploring fine-grained controllability . however, their performance at scale is limited due to data scarcity . |
| Approach: | They propose a multi-task learning problem for high-controllability text-to-audio generation . they propose scalable diffusion transformers that augment condition information in sequence . |
| Outcome: | The proposed method outperforms existing methods on objective and subjective evaluations. |
StyleTTS-ZS: Efficient High-Quality Zero-Shot Text-to-Speech Synthesis with Distilled Time-Varying Style Diffusion (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in text-to-speech (TTS) models have led to improvements in speaker prosody and voices modeling. |
| Approach: | They propose an efficient zero-shot TTS model that leverages distilled time-varying style diffusion to capture diverse speaker identities and prosodies. |
| Outcome: | The proposed model surpasses state-of-the-art models in both naturalness and similarity while reducing inference speed by 90%. |
T⋆: Progressive Block Scaling for Masked Diffusion Language Models Through Trajectory Aware Reinforcement Learning (2026.acl-short)
Copied to clipboard
| Challenge: | Autoregressive (AR) modeling via next-token prediction dominates scaling practice and deployed systems. |
| Approach: | They propose a TraceRL-based curriculum for progressive block-size scaling in masked diffusion language models. |
| Outcome: | The proposed curriculum outperforms direct large-block TraceRL on two SDAR scales and three benchmarks and retains block-size-specific non-monotone updates while improving accuracy. |
Efficient Transformer Knowledge Distillation: A Performance Review (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Pretrained transformer language models have been gaining popularity in the field of natural language processing . however, there is no study into the intersection of these two fields . |
| Approach: | They propose a method to extract knowledge from transformers to produce high-performing efficient attention models with low costs. |
| Outcome: | The proposed model compression method preserves up to 98.6% of original model performance across short-context tasks and up to 95.8% on long-concept Named Entity Recognition tasks while decreasing inference times by up to 57%. |
Diffusion with Truncated Blocks: Fast and High-Quality Text Generation using Truncated Block Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Diffusion-based Large Language Models (dLLMs) generate text by iteratively denoising masked sequences. |
| Approach: | They propose a method that iteratively denoises masked sequences to reduce the model's attention dilution by token-level noise while models employing sequence-level noising exhibit a reduced effect. |
| Outcome: | The proposed method improves the performance and efficiency of Diffusion-based large language models by iterating on masked sequences. |