Enhancing Polyglot Voices by Leveraging Cross-Lingual Fine-Tuning in Any-to-One Voice Conversion (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in speech synthesis have improved the quality of polyglot voices. |
| Approach: | They propose a cross-lingual any-to-one voice conversion system that preserves the source accent without multilingual data from the target speaker. |
| Outcome: | The proposed system preserves source accent without multilingual data from target speaker and reduces training data requirements. |
Similar Papers
O_O-VC: Synthetic Data-Driven One-to-One Alignment for Any-to-Any Voice Conversion (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Traditional voice conversion methods attempt to separate speaker identity and linguistic information into distinct representations, but this method often leads to information loss during training. |
| Approach: | They propose a method that leverages synthetic speech data generated by a pretrained model . synthetic data pairs that share the same linguistic content are used as input-output pairs . |
| Outcome: | The proposed method outperforms state-of-the-art methods in speaker-to-voice conversions. |
Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models that target a single language are not seen during finetuning, but are able to respond in multiple languages once deployed in downstream applications. |
| Approach: | They investigate the minimal amount of multilinguality required during finetuning to elicit effective cross-lingual generalisation in English-centric LLMs. |
| Outcome: | The proposed model can respond in as few as two to three languages to a user's query in English, but the degree to which a target language is seen during pretraining is limiting. |
Exploring Cross-Lingual Voice Conversion Methods for Anonymizing Low-Resource Text-to-Speech (2026.eacl-short)
Copied to clipboard
| Challenge: | a growing number of speech synthesis systems clone a person's voice, a new study finds . a variety of voice conversion techniques can mask speaker identities in low-resource text-to-speech systems. |
| Approach: | They compare voice conversion techniques to mask speaker identities in text-to-speech systems . they build and evaluate speaker-anonymized systems for two Canadian Indigenous languages . |
| Outcome: | The proposed methods are compared with other approaches for using voice conversion to mask speaker identities in low-resource text-to-speech systems. |
Sources of Transfer in Multilingual Named Entity Recognition (2020.acl-main)
Copied to clipboard
| Challenge: | naive training of named-entity recognition models using annotated data from multiple languages consistently underperforms monolingual models. |
| Approach: | They propose a polyglot named-entity recognition model where one model is trained using annotated data drawn from multiple languages. |
| Outcome: | The proposed model outperforms models trained on monolingual data despite more training data . the proposed model shares many parameters across languages and fine-tunes them to outperFORM monolingual models. |
CC-Tuning: A Cross-Lingual Connection Mechanism for Improving Joint Multilingual Supervised Fine-Tuning (2025.acl-long)
Copied to clipboard
Yangfan Ye, Xiaocheng Feng, Zekun Yuan, Xiachong Feng, Libo Qin, Lei Huang, Weitao Ma, Yichong Huang, Zhirui Zhang, Yunfei Lu, Xiaohui Yan, Duyu Tang, Dandan Tu, Bing Qin
| Challenge: | Existing fine-tuning approaches that focus on English-centric training corpora often introduce implicit cross-lingual alignment, overlooking the potential for more profound, latent-level cross-linguistic interactions. |
| Approach: | They propose a multilingual fine-tuning paradigm that explicitly establishes a cross-lingual connection mechanism at the latent level. |
| Outcome: | The proposed model outperforms vanilla SFT and offers a strong latent-level alternative to data-level augmentation methods. |
EZ-VC: Easy Zero-shot Any-to-Any Voice Conversion (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current voice conversion methods struggle in zero-shot cross-lingual settings . authors develop a method that can be used in zero shot cross-linguistic settings despite advances in technology . |
| Approach: | They propose a voice-conversion model that combines discrete speech representations with a non-autoregressive speech decoder. |
| Outcome: | The proposed approach excels in zero-shot cross-lingual settings even for unseen languages and accents. |
Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions? (2024.emnlp-main)
Copied to clipboard
Alexander Weber, Klaudia Thellmann, Jan Ebert, Nicolas Flores-Herr, Jens Lehmann, Michael Fromm, Mehdi Ali
| Challenge: | a study of multilingual pre-trained LLMs on parallel instruction-tuning benchmarks shows that instruction-following models can be used across languages by up to 9.9%. |
| Approach: | They conduct an extensive study of the performance of multilingual pre-trained LLMs instruction-tuned on parallel instruction-uning datasets. |
| Outcome: | The proposed model improves cross-lingual instruction following capabilities by 9.9% on a large and mid-sized LLM on parallel instruction-tuning datasets. |
Cross-Lingual Optimization for Language Transfer in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Adapting large language models to other languages often suffers from an overemphasis on English performance. |
| Approach: | They propose a cross-lingual optimization technique that efficiently transfers an English-centric LLM to a target language while preserving its English capabilities. |
| Outcome: | The proposed model outperforms SFT in acquiring target language proficiency and maintaining English performance in low-resource languages. |
Cross-lingual Intermediate Fine-tuning improves Dialogue State Tracking (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to make multilingual systems expensive and tedious introduce pipeline of errors. |
| Approach: | They propose to use pre-trained multilingual models to enhance the transfer learning process by intermediate fine-tuning of pretrained multi-lingual models. |
| Outcome: | The proposed approach improves on the cross-lingual dialogue state tracking task with only 10% of the target language task data and zero-shot setup respectively. |
Consistency Regularization for Cross-Lingual Fine-Tuning (2021.acl-long)
Copied to clipboard
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
| Challenge: | Experimental results show that consistency regularization improves cross-lingual fine-tuning . pre-trained cross-linguistic models can transfer task-specific supervision from one language to the other . |
| Approach: | They propose to improve cross-lingual fine-tuning with consistency regularization . they use example consistency regularized to penalize prediction sensitivity to four types of data augmentations . |
| Outcome: | The proposed method improves cross-lingual fine-tuning across tasks . it can be generalized to other target languages without additional training . |