Papers by Zhengyan Sheng
UniSpeaker: A Unified Approach for Multimodality-driven Speaker Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new framework for speaker generation is proposed to enable multimodal speaker generation . multimodal cues such as visual appearance, textual descriptions, and other biometric signals are still in its early stages. |
| Approach: | a new framework is proposed to enable multimodal speaker generation . the framework uses self-distillation to apply speaker disentanglement to speech generation a model is developed . |
| Outcome: | The proposed framework is the first to support unified voice generation from arbitrary modality combinations. |