Papers with V2S
DiVISe: Direct Visual-Input Speech Synthesis Preserving Speaker Characteristics And Intelligibility (2025.findings-naacl)
Copied to clipboard
| Challenge: | Video-to-speech (V2S) synthesis requires acoustic hints to accurately reconstruct both speech content and speaker characteristics from video clips alone. |
| Approach: | They propose a video-to-speech (V2S) model that predicts Mel-spectrograms directly from video frames. |
| Outcome: | The proposed model outperforms existing models in acoustic intelligibility and preserves speaker-specific characteristics. |