Papers by Rongjie Huang

22 papers
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have been used for general-purpose interfaces across multiple tasks and languages.
Approach: They propose to use large language models as a general-purpose interface across multiple tasks and languages.
Outcome: The proposed model performs better on 200K hours of 6-language data for voice generation applications.
Masked Text-to-Audio Flow-Matching and Reward Feedback Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Experimental results show that Flow-matching generative models can scale training by increasing data, computational resources, and model size.
Approach: They propose a flow-matching transformer with masked generative modeling for scaling text-to-audio inference-time prediction.
Outcome: The proposed model scales inference-time computations by masking generation and re-predicting them through iterative decoding.
RMSSinger: Realistic-Music-Score based Singing Voice Synthesis (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for singing voice synthesis are limited to fine-grained music scores . manual adjustment destroys regularity of note durations, making fine-grain music scores "crushed"
Approach: They propose a method to synthesize singing voices given realistic music scores . they use real-music-score-based Singing Voice Synthesis to generate high-quality voices .
Outcome: The proposed method eliminates manual annotation and simplifies phoneme-level mel-note alignment.
FastDiff 2: Revisiting and Incorporating GANs and Diffusion Models in High-Fidelity Speech Synthesis (2023.findings-acl)

Copied to clipboard

Challenge: Experimental results show that Generative adversarial networks sacrifice sample diversity for quality and speed, while diffusion models exhibit outperformed sample quality and diversity at a high computational cost.
Approach: They propose to combine GANs and diffusion probabilistic models to achieve better sample quality and diversity.
Outcome: The proposed models outperform GANs and diffusion models in speech synthesis . the proposed models enjoy an efficient 4-step sampling process and exhibit better sample diversity .
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control (2024.emnlp-main)

Copied to clipboard

Challenge: Existing models fail to generate singing voices rich in stylistic nuances for unseen singers due to multifaceted nature of singing styles.
Approach: They propose a zero-shot SVS model for style transfer across cross-lingual speech and singing styles and multi-level style control.
Outcome: Experimental results show that TCSinger outperforms baseline models in synthesis quality, singer similarity, and style controllability.
FlashAudio: Rectified Flow for Fast and High-Fidelity Text-to-Audio Generation (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in latent diffusion models (LDMs) have markedly enhanced text-to-audio generation, yet their iterative sampling processes impose substantial computational demands, limiting practical deployment.
Approach: They propose to learn straight flow for fast simulation by using flashAudio with rectified flows and immiscible flow to minimize the total distance of data-noise pairs in a batch vias assignment.
Outcome: The proposed method can learn straight flow for fast simulations and reduce noise distribution.
AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignment (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to speech-to-singing voice conversion are difficult to learn in text-free situations.
Approach: They propose an STS model which views speech variance as different modalities . it uses a novel rhythm adaptor to predict the target rhythm representation . they also use the predicted rhythm representation to re-align the content .
Outcome: The proposed model achieves superior performance in terms of objective and subjective metrics.
Speech-to-Speech Translation with Discrete-Unit-Based Style Transfer (2024.acl-srw)

Copied to clipboard

Challenge: Existing methods to translate spoken utterances from one language to another are unable to preserve speaker timbre of source speech.
Approach: They propose a pipeline with style-transfer capability on the basis of self-supervised speech representations and codec units.
Outcome: The proposed model achieves zero-shot cross-lingual style transfer on previously unseen source languages.
Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarization on Multi-party Conversation (2025.acl-long)

Copied to clipboard

Challenge: Mainstream speaker diarization systems rely only on acoustic information, making it challenging in complex aural environments.
Approach: They propose a multimodal approach that integrates audio, visual, and semantic cues to enhance speaker diarization.
Outcome: The proposed approach outperforms state-of-the-art methods on multi-party conversations . it integrates audio-visual-semantic cues into the clustering process for acoustic speaker embeddings .
Contrastive Token-Wise Meta-Learning for Unseen Performer Visual Temporal-Aligned Translation (2023.findings-acl)

Copied to clipboard

Challenge: a novel generalization framework for visual temporal-aligned translation is proposed to transfer recognition skills to unseen performers . ambiguity in the visual sequence can hinder current methods for visual language translation .
Approach: They propose a generalizable framework to transfer recognition skills to unseen performers . they use visual temporal-aligned translation to generate multiple words autoregressively .
Outcome: The proposed framework is generalized to transfer recognition skills to unseen performers . it is compared with existing methods on lipreading and fingerspelling datasets .
TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for talking head translation rely on cascading, resulting in delays and cascadic errors.
Approach: They propose a model for talking head translation, TransFace, which can translate audio-visual speech into audio-visual speech in other languages.
Outcome: The proposed model can translate audio-visual speech into audio-visual speech in other languages.
Versatile Framework for Song Generation with Prompt-based Control (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for song generation fail to generate vocals with prompt-based control and proper alignment.
Approach: VersBand is a multi-task song generation framework for synthesizing high-quality songs with prompt-based control.
Outcome: Experimental results show that VersBand performs better than baseline models across multiple song generation tasks.
ViT-TTS: Visual Text-to-Speech with Scalable Diffusion Transformer (2023.emnlp-main)

Copied to clipboard

Challenge: Text-to-speech (TTS) performance has improved with the advent of denoising Diffusion Probabilistic Models . however, perceived quality of audio depends on content, pitch, rhythm, and energy .
Approach: They propose a visual TTS model with scalable diffusion transformers that complement phoneme sequences with visual information to generate high-perceived audio.
Outcome: The proposed model outperforms existing models regardless of visibility of the scene . it can generate high-perceived audio, opening up new avenues for AR and VR applications .
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for speech editing still suffer from over-smoothing problem and lack of robustness due to stutter.
Approach: They propose a stutter-oriented automatic speech editing model that incorporates sutter information into the hidden sequence.
Outcome: The proposed model achieves state-of-the-art performance on a speech recording dataset . it can improve fluency of stuttering speech in terms of objective and subjective metrics.
Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt (2024.naacl-long)

Copied to clipboard

Challenge: Recent singing-voice-synthesis methods lack ability to control style attributes of synthesized singing.
Approach: They propose a singing-voice-synthesis method that enables attribute controlling on singer gender, vocal range and volume with natural language.
Outcome: The proposed method achieves favorable control ability and audio quality.
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for expressive text-to-speech only implicitly learn prosody with masked token reconstruction tasks.
Approach: They propose a cross-modal contrastive pre-training framework that learns from prosody variance of the same text token under different contexts.
Outcome: The proposed framework can learn from prosody variance of a text token under different contexts.
Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies on speech-to-singing voice conversion (STS) are limited by the scarcity of paired speech-song data and the suboptimal quality of outputs.
Approach: They propose a self-supervised singing voice pre-training model that transforms a speech-to-singing voice into a paired singing voice.
Outcome: The proposed model improves both STS and singing voice synthesis tasks by combining spoken language and a self-supervised singing voice pre-training model.
AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing models for speech-to-speech translation suffer from distinct degradation in noisy environments and fail to translate visual speech.
Approach: They propose a text-based audio-visual speech-to-speech translation model that integrates visual information with audio-only data to improve system robustness.
Outcome: The proposed model outperforms models trained on audio-only corpus in two languages . it also improves with low-resource audio-visual data, compared with baselines .
Robust Singing Voice Transcription Serves Synthesis (2024.acl-long)

Copied to clipboard

Challenge: Current AST methods struggle with accuracy and robustness when used for practical annotation.
Approach: They propose a model that converts singing recordings into note sequences for automatic annotation of singing datasets.
Outcome: The proposed model outperforms baseline models on enlarged, automatically annotated datasets.
Text-to-Song: Towards Controllable Music Generation Incorporating Vocal and Accompaniment (2024.acl-long)

Copied to clipboard

Challenge: Existing studies focus on singing voice synthesis and music generation independently.
Approach: They propose a novel task called Text-to-Song synthesis which incorporates both vocal and accompaniment generation.
Outcome: The proposed method can synthesize songs with comparable quality and style consistency.
Wav2SQL: Direct Generalizable Speech-To-SQL Parsing (2024.findings-acl)

Copied to clipboard

Challenge: Existing models for speech-driven SQL parsing are based on a cascaded approach, resulting in data scarcity and inconsistent performance.
Approach: They propose a direct generalizable speech-to-SQL parsing model which avoids error compounding across cascaded systems.
Outcome: The proposed model avoids error compounding and achieves state-of-the-art results by 4.7% improvement over baseline.
Prosody-TTS: Improving Prosody with Masked Autoencoder and Conditional Diffusion Model For Expressive Text-to-Speech (2023.findings-acl)

Copied to clipboard

Challenge: Expressive text-to-speech aims to generate high-quality samples with rich prosody . prosodic attributes in highly dynamic voices are difficult to capture and model without intonation .
Approach: They propose a pipeline that enhances prosody modeling and sampling by introducing a self-supervised masked autoencoder and a diffusion model to sample diverse prosodic patterns within the latent space.
Outcome: The proposed pipeline achieves new state-of-the-art in text-to-speech with natural and expressive synthesis.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations